-- Logs begin at Thu 2022-05-19 14:11:11 UTC, end at Thu 2022-05-19 15:23:36 UTC. -- May 19 14:56:19.296790 dv-cinder-825492-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 14:56:19.304183 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 14:56:19.306131 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 14:56:19 2022] *** May 19 14:56:19.306131 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 14:56:19.306131 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 14:56:19.306131 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: nodename: dv-cinder-825492-12-iscsi May 19 14:56:19.306131 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: machine: x86_64 May 19 14:56:19.306131 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: clock source: unix May 19 14:56:19.306131 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: pcre jit disabled May 19 14:56:19.306625 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: detected number of CPU cores: 4 May 19 14:56:19.306625 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: current working directory: / May 19 14:56:19.306625 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: detected binary path: /usr/bin/uwsgi-core May 19 14:56:19.306625 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: your processes number limit is 47680 May 19 14:56:19.306625 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: your memory page size is 4096 bytes May 19 14:56:19.306625 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: detected max file descriptor number: 2048 May 19 14:56:19.306625 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: lock engine: pthread robust mutexes May 19 14:56:19.306625 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: thunder lock: enabled May 19 14:56:19.306625 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 14:56:19.306625 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 14:56:19.353222 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: Python main interpreter initialized at 0x560fa7e469c0 May 19 14:56:19.353222 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: python threads support enabled May 19 14:56:19.353222 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: your server socket listen backlog is limited to 100 connections May 19 14:56:19.353222 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: your mercy for graceful operations on workers is 90 seconds May 19 14:56:19.353591 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: mapped 403077 bytes (393 KB) for 2 cores May 19 14:56:19.353675 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: *** Operational MODE: preforking *** May 19 14:56:19.353933 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: *** uWSGI is running in multiple interpreter mode *** May 19 14:56:19.353933 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: spawned uWSGI master process (pid: 103022) May 19 14:56:19.354129 dv-cinder-825492-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 14:56:19.354715 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: spawned uWSGI worker 1 (pid: 103023, cores: 1) May 19 14:56:19.355057 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: spawned uWSGI worker 2 (pid: 103024, cores: 1) May 19 14:56:19.355191 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 14:56:20.531637 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 14:56:20.558232 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 14:56:21.254247 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:56:21.254247 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: from cryptography.utils import int_from_bytes May 19 14:56:21.254557 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:56:21.254557 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: from cryptography.utils import int_from_bytes May 19 14:56:21.264432 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:56:21.264432 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: from cryptography.utils import int_from_bytes May 19 14:56:21.264758 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 14:56:21.264758 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: from cryptography.utils import int_from_bytes May 19 14:56:23.841559 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 14:56:23.842130 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 14:56:23.842311 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 14:56:23.842661 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 14:56:23.842911 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 14:56:23.843317 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.843638 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.843952 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.844263 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.844357 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 14:56:23.844715 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.844804 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 14:56:23.844899 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.845105 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 14:56:23.845199 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.845464 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.845555 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 14:56:23.845719 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 14:56:23.845823 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.846022 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.846108 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.846332 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.846440 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.846649 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-12-iscsi {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.846756 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.846959 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.847052 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.847799 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.847908 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.848108 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.848215 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.848416 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.848510 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.848712 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.848805 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.849026 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.849118 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.849322 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.849407 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.849659 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.849808 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.849988 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-12-iscsi {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.851137 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.851335 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.851423 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.851501 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.851644 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.851766 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.851886 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.852019 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.852145 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.852274 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.852396 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.852521 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.852647 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.852767 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.852885 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.853021 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.853146 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.853275 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.853402 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.853534 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-12-iscsi {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.853788 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.853918 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.854038 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.854165 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.854291 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.854401 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.854527 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.854646 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.854765 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.854895 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.855070 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.855227 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.855421 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.855550 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.855732 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.855863 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.856102 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.856243 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-12-iscsi {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.856417 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.856553 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.856728 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.856860 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.857040 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.857252 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.857384 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.857507 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.857636 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.857759 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.857912 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.858040 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.858215 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.858356 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.858522 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.858645 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.858819 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.858954 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.859113 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.859313 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.859416 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.859634 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.859735 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.859955 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.860049 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.860267 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.860415 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.860563 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.860703 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.860839 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.860972 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.861120 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.861254 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.861386 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.861509 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.861631 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.861761 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.861916 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.862044 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.862215 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.862348 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.862512 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.862638 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.862853 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.863771 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.863906 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.864036 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.864166 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.864289 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.864419 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.864551 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.864675 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.864796 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.864927 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.865051 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.865186 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.865309 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.865438 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.865560 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.865692 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.865826 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.866003 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.866140 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.866345 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.866469 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.866628 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.866727 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.866914 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.867008 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.867250 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.867350 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.867561 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.867653 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.867859 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.867965 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.868435 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.868602 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.868742 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.868889 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.869034 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.869132 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.869331 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.869417 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.869629 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.869732 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.869940 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.870026 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.870255 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.870340 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.870552 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.870654 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.870796 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.870887 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.871090 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.871175 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.871412 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.871512 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.871721 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.871823 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.872020 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.872106 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.872318 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.872418 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.872616 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.872701 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.872908 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.873001 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.873206 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.873293 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.873502 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.873602 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.873799 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.873894 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.874092 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.874187 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.874389 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.874477 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.874684 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.874781 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.874980 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.875074 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.875297 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.875388 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.875594 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.875690 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.875901 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.875993 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.876209 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.876305 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.876505 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.876641 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.876799 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.876940 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.877101 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.877238 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.877397 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.877525 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.877699 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.877824 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.877994 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.878140 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.878276 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.878445 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.878611 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.878737 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.878905 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.879030 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.879228 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.879377 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.879529 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.879666 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.879874 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.880008 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.880129 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.880259 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.880419 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.880554 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.880707 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.880833 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.881006 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.881142 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.881312 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.881439 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.881609 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.881744 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.881905 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.882041 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.882198 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.882333 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.882491 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.882626 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.882789 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.882926 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.883082 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.883231 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.883410 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.883547 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.883755 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.883888 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.884021 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.884145 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.884266 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.884388 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.884568 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.884695 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.884868 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.885003 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.885166 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.885293 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.885461 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.885589 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.885763 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.885887 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.886069 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.886195 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.886371 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.886498 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.886674 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.886792 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.886974 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.887110 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.887314 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.887442 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.887636 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.887773 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.887943 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.888083 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.888245 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.888370 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.888545 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.888669 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.888860 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.888994 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 14:56:23.889165 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.889291 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.889467 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.889603 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.889770 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.889897 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.890080 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.890207 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.890388 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.890515 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.890752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.890881 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.891010 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.891140 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.891306 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.891430 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.891619 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.891753 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.891922 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.892081 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.892219 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.892342 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.892534 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.892662 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.892848 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.892967 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.893151 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.893285 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.893484 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.893613 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.893818 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.893952 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.894148 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.894288 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.894464 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.894597 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.894772 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.894897 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.895074 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.895231 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.895400 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.895528 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.895702 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.895830 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.896017 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.896153 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.896333 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.896459 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.896634 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.896760 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.896944 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.897079 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.897252 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.897379 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.897553 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.897681 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.897853 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.897989 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.898154 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.898288 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.898456 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.898584 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.898784 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.898920 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.899090 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.899256 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.899422 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.899550 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.899723 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.899852 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.900031 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.900158 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.900332 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.900459 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.900632 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.900760 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.900930 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.901057 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.901224 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.901351 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.901517 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.901653 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.901811 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.901939 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.902110 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.902237 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.902403 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.902544 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.902713 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.902841 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.903030 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.903166 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.903352 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.903480 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.903671 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.903798 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.903966 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.904101 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.904267 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.904393 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.904569 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.904696 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.904867 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.905003 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.905162 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.905298 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.905461 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.905587 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.905759 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.905962 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.906087 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.906219 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.906342 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.906464 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.906642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.906782 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.906940 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.907060 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.907282 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.907415 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.907580 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.907716 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.907874 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.908010 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.908178 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.908305 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.908479 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.908608 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.908779 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.908907 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.909079 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.909206 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.909377 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.909513 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.910226 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.910404 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.910540 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.910672 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.910796 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.910917 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.911116 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.911257 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.911447 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.911587 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.911746 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.911880 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.912056 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.912183 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.912365 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.912501 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.912668 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.912795 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.912965 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.913092 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.913267 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.913407 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.913562 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.913695 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.913857 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.913995 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.914152 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.914281 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.914450 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.914578 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.914744 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.914871 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.915037 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.915173 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.915345 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.915466 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.915636 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.915761 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.915930 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.916058 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.916240 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.916375 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.916537 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.916663 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.916830 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.916951 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.917125 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.917257 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.917418 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.917553 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.917755 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.917881 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.918051 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.918176 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.918348 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.918483 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.918652 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.918777 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.918954 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.919079 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.919303 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.919447 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.919608 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.919732 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.919908 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.920032 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.920210 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.920342 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.920508 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.920633 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.920809 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.920934 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.921111 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.921246 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.921422 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.921556 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.921726 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.921851 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.922037 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.922163 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.922340 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.922465 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.922654 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.922780 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.922957 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.923083 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.923291 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.923417 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.923589 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.923727 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.923897 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.924023 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.924205 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.924328 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.924531 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.924655 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.924834 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.924959 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.925145 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.925277 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.926021 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.926156 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.926305 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.926431 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.926606 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.926740 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.926907 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.927040 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.927224 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.927353 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.927534 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.927659 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.927847 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.927986 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.928148 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.928279 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.928456 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.928591 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.928756 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.928896 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.929067 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.929194 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.929366 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.929501 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.929671 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.929799 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.929965 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.930092 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.930266 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.930394 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.930573 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.930699 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.930891 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.931027 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.931189 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.931349 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.931515 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.931645 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.931821 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.931946 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.932121 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.932253 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.932421 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.932550 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.932724 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.932852 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.933019 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.933147 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.933317 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.933445 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.933616 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.933743 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.933921 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.934061 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.934221 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.934355 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.934520 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.934648 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.934815 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.935019 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.935145 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.935301 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.935425 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.935547 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.935710 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.935857 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.936003 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.936131 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.936304 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.936439 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.936612 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.936749 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.936911 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.937039 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.937222 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.937349 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.937531 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.937659 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.937828 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.937962 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.938121 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.938256 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.938426 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.938553 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.938721 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.938847 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.939016 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.939147 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.939337 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.939468 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.939631 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.939758 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.939948 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.940073 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.940249 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.940377 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.940541 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.940668 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.940845 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.941002 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.941174 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.941307 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.941490 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.941618 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.941794 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.941928 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.942093 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.942218 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.942393 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.942526 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.942695 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.942831 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.942997 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.943123 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.943322 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.943451 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.943626 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.943766 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.943927 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.944054 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.944228 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.944355 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.944529 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.944667 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.944842 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.944970 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.945143 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.945270 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.945446 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.945572 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.945745 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.945871 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.946041 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.946168 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.946342 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.946470 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.946651 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.946778 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.946962 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.947259 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.947409 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.947543 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.947675 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.947847 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.947975 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.948158 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.948286 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.948468 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.948596 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.948780 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.948908 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.949080 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.949207 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.949390 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.949526 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.949707 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.949842 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.950007 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.950268 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.950397 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.950592 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.950718 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.950891 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.951020 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.951192 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.951341 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.951510 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.951650 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.951806 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.951934 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.952102 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.952230 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.952403 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.952531 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.952698 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.952826 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.952992 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.953138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.953285 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.953413 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.953579 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.953708 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.953884 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.954020 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.954178 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.954306 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.954479 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.954606 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.954773 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.954902 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.955084 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.955257 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.955409 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.955549 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.955687 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.955812 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.955983 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.956118 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.956277 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.956406 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.956634 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.956770 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.956928 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.957053 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.957238 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.957364 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.957548 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.957676 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.957851 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.957979 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.958165 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.958364 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.958491 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.958621 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.958752 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.958881 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.959044 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.959180 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.959362 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.959500 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.959659 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.959786 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.959958 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.960094 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.960256 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.960385 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.960549 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.960686 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.960850 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.960987 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.961149 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.961277 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.961448 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.961576 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.961746 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.961881 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.962037 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.962164 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.962334 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.962463 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.962627 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.962756 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.962931 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.963058 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.963251 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.963394 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.963572 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.963698 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.963823 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.963946 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.964111 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.964238 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.964407 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.964535 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.964699 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.964826 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.964996 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.965132 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.965288 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.965415 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.965592 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.965720 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.965885 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.966022 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.966177 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.966304 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.966470 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.966597 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.966766 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.966904 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.967065 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.967218 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.967384 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.967510 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.967684 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.967822 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.967987 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.968113 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.968281 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.968409 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.968574 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.968711 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.968871 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.968998 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.969164 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.969293 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.969458 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.969586 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.969756 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.969892 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.970061 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.970186 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.970361 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.970489 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.970652 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.970777 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.970949 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.971092 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.971298 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.971437 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.971562 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.971684 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.971827 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.971965 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.972125 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.972818 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.972946 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.973069 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.973221 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.973363 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.973514 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.973680 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.973799 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.973995 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.974130 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.974299 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.974427 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.974607 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.974735 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.974913 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.975042 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.975234 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.975366 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.975528 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.975655 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.975834 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.975978 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.976137 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.976264 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.976438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.976565 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.976737 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.976874 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.977036 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.977164 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.977337 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.977463 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.977640 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.977767 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.977943 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.978078 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.978241 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.978366 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.978532 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.978667 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.978830 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.978955 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.979127 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.979266 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.979478 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.979607 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.979774 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.979911 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.980069 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.980203 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.980379 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.980508 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.980680 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.980808 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.980980 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.981107 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.981290 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.981419 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.981601 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.981735 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.981899 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.982024 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.982195 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.982329 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.982496 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.982636 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.982796 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.982923 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.983095 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.983290 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.983410 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.983525 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.983703 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.984002 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.984122 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.984306 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.984607 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.984719 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.984908 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.985202 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.985315 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.985496 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.985794 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.985905 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.986091 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.986229 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.986386 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.986514 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.986699 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.986827 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.986998 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.987228 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.987356 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.987479 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.987600 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.987723 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.988437 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.988569 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.988742 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.988878 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.989037 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.989164 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.989419 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.989546 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.989732 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.989867 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.990030 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.990156 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.990324 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.990453 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.990623 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.990750 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.990923 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.991050 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.991248 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.991380 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.991556 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.991682 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.991847 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.991982 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.992178 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.992304 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.992485 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.992620 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.992800 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.992942 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.993373 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.993513 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.993898 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.994024 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.994128 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.994260 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.994399 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.994532 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.994663 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.994787 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.994908 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.995043 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.995166 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.995311 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.995450 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.995604 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.995741 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.995916 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.996051 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.996229 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.996357 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.996543 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.996680 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.996848 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.996975 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.997234 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.997359 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.997561 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.997700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.997871 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.997991 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.998181 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.998308 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.998483 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.998619 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.998787 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.998914 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.999099 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.999280 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.999420 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.999544 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.999710 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:23.999837 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.000012 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.000140 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.000316 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.000443 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.000632 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.000758 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.000934 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.001060 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.001239 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.001366 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.001536 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.001663 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.001849 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.002065 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.002207 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.002333 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.002468 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.002635 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.002763 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.002942 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.003144 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.003293 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.003517 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.003648 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.003822 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.003950 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.004134 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.004271 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.004451 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.004587 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.004747 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.004875 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.005041 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.005177 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.005340 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.005477 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.005635 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.005762 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.005929 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.006066 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.006242 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.006369 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.006536 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.006671 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.006837 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.006974 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.007137 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.007330 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.007456 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.007679 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.007823 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.007950 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.008070 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.008253 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.008381 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.008576 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.008714 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.008887 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.009015 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.009205 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.009339 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.009521 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.009659 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.009824 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.009950 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.010118 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.010244 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.010425 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.010560 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.010724 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.010851 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.011020 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.011148 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.011341 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.011471 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.011639 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.011768 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.011962 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.012087 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.012253 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.012387 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.012565 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.012699 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.012869 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.013004 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.013172 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.013300 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.013474 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.013608 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.013782 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.013916 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.014101 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.014229 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.014409 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.014536 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.014717 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.014859 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.015033 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.015162 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.015353 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.015494 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.015651 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.015788 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.015952 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.016081 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.016247 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.016375 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.016544 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.016680 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.016840 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.016975 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.017138 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.017267 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.017433 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.017570 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.017733 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.017864 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.018026 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.018154 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.018339 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.018468 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.018632 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.018761 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.018944 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.019091 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.019299 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.019431 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.019597 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.019726 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.019893 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.020021 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.020187 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.020323 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.020518 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.020646 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.020813 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.020949 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.021137 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.021266 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.021439 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.021565 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.021745 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.021929 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.022056 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.022178 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.022339 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.022467 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.022643 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.022779 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.022945 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.023073 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.023266 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.023410 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.023573 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.023709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.023876 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.024002 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.024180 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.024306 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.024486 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.024622 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.024784 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.024912 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.025082 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.025208 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.025380 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.025517 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.025683 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.025809 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.025989 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.026125 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.026358 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.026494 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.026619 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.026833 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.026966 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.027097 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.027253 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.027431 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.027573 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.027744 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.027872 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.028051 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.028180 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.028357 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.028491 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.028661 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.028800 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.028963 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.029093 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.029264 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.029392 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.029565 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.029687 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.029884 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.030020 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.030197 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.030325 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.030512 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.030641 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.030827 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.030962 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.031135 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.031319 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.031472 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.031676 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.031806 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.032005 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.032133 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.032322 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.032451 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.032636 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.032767 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.032947 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.033075 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.033260 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.033396 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.033564 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.033698 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.033871 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.033998 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.034174 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.034310 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.034475 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.034610 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.035327 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.035457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.035636 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.035777 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.035940 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.036069 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.036241 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.036370 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.036545 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.036674 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.036849 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.036977 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.037163 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.037291 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.037489 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.037618 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.037800 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.037933 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.038101 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.038235 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.038404 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.038540 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.038710 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.038845 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.039049 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.039231 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.039406 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.039545 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.039724 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.039859 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.040035 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.040179 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.040345 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.040471 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.040659 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.040794 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.040972 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.041111 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.041285 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.041413 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.041597 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.041724 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.041912 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.042041 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.042211 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.042337 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.042512 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.042640 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.042809 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.042938 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.043123 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.043272 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.043453 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.043580 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.043749 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.043878 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.044059 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.044187 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.044361 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.044649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.044882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.045011 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.045218 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.045347 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.045526 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.045662 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.045844 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.045972 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.046159 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.046287 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.046467 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.046603 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.046765 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.046893 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.047081 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.047293 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.047421 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.047557 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.047683 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.047813 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.047989 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.048127 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.048293 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.048431 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.048588 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.048727 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.048884 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.049012 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.049184 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.049319 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.049484 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.049621 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.049780 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.049901 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.050081 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.050907 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.051068 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.051263 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.051396 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.051584 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.051727 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.051879 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.052006 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.052177 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.052305 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.052480 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.052609 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.052776 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.052903 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.053070 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.053215 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.053354 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.053479 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.053648 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.053777 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.053951 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.054080 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.054246 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.054374 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.054547 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.054674 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.054840 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.054968 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.055151 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.055309 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.055463 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.055599 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.055762 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.055965 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.056098 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.056222 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.056383 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.056511 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.056698 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.056841 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.056967 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.057089 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.057275 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.057404 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.057577 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.057714 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.057884 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.058011 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.058187 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.058321 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.058500 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.058668 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.058780 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.058883 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.059075 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.059228 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.059411 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.059645 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.059774 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.059969 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.060097 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.060281 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.060418 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.060591 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.060717 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.060893 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.061021 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.061193 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.061328 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.061492 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.061620 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.061790 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.061925 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.062105 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.062242 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.062406 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.062534 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.062709 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.062838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.063010 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.063140 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.063337 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.063468 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.063634 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.063761 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.063924 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.064060 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.064223 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.064351 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.064522 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.064656 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.064820 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.065090 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.065218 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.065407 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.065532 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.065706 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.065842 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.066048 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.066184 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.066381 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.066518 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.066690 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.066818 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.066997 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.067122 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.067325 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.067473 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.067640 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.067768 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.067941 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.068076 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.068245 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.068397 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.068548 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.068686 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.068848 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.068976 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.069155 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.069290 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.069467 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.069593 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.069773 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.069899 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.070072 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.070207 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.070377 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.070504 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.070686 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.070813 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.070996 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.071132 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.071339 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.071468 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.071656 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.071796 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.071977 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.072105 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.072291 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.072420 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.072588 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.072713 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.072894 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.073023 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.073196 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.073324 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.073504 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.073686 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.073822 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.073947 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.074107 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.074234 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.074416 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.074543 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.074720 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.074856 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.075017 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.075146 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.075372 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.075510 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.075635 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.075759 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.075920 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.076048 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.076221 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.076357 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.076519 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.076646 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.076814 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.076941 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.077113 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.077250 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.077407 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.077542 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.077708 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.077862 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.078016 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.078171 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.078299 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.078502 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.078631 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.078802 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.078939 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.079129 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.079275 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.079446 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.079572 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.079740 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.079880 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.080079 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.080203 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.080325 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.080455 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.080614 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.080743 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.080909 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.081036 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.081204 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.081330 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.081496 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.081646 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.081815 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.081950 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.082110 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.082239 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.082432 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.082570 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.082755 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.082883 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.083060 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.083189 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.083384 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.083509 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.083672 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.083808 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.083975 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.084177 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.084304 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.084425 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.084569 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.084703 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.084870 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.085011 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.085175 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.085301 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.085475 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.085601 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.085777 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.085919 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.086078 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.086215 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.086379 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.086506 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.086677 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.086811 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.086976 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.087102 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.087295 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.087423 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.087601 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.087737 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.087898 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.088024 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.088223 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.088359 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.088531 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.088660 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.088848 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.088975 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.089156 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.089284 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.089462 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.089588 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.089766 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.089891 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.090067 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.090208 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.090384 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.090518 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.090683 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.090809 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.090984 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.091120 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.091318 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.091445 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.091661 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.091802 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.091928 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.092063 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.092211 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.092339 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.092517 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.092645 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.092827 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.092962 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.093136 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.093272 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.093435 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.093562 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.093752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.093881 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.094069 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.094197 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.094371 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.094498 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.094693 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.094822 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.095009 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.095136 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.095350 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.095478 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.095657 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.095786 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.095959 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.096091 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.096254 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.096391 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.096523 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103024) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 14:56:24.096655 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.096869 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.097692 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.098004 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.098316 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.098631 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.098946 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.099292 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.099621 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.099933 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.100259 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.100585 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.100931 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.101242 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.101584 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.101912 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.102226 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.102538 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.102842 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 14:56:24.103084 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 14:56:24.154402 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] Registered counter for database nova_api May 19 14:56:24.161840 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO dbcounter [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] Registered counter for database nova_api May 19 14:56:24.174668 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:56:24.181848 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:56:24.182276 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG oslo_db.sqlalchemy.engines [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:56:24.188787 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writer thread running {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:56:24.237381 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.context [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29378f11-e05f-41fc-b3d7-85c26456dbc0(cell1) {{(pid=103024) load_cells /opt/stack/nova/nova/context.py:464}} May 19 14:56:24.243617 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:56:24.245194 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:56:24.245977 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:56:24.246483 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.context [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29378f11-e05f-41fc-b3d7-85c26456dbc0(cell1) {{(pid=103023) load_cells /opt/stack/nova/nova/context.py:464}} May 19 14:56:24.247924 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:56:24.249879 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] Registered counter for database nova_cell0 May 19 14:56:24.251976 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:56:24.253692 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:56:24.254015 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] Registered counter for database nova_cell1 May 19 14:56:24.254497 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:56:24.256573 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG oslo_concurrency.lockutils [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:56:24.258559 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO dbcounter [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] Registered counter for database nova_cell0 May 19 14:56:24.261430 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:56:24.262784 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO dbcounter [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] Registered counter for database nova_cell1 May 19 14:56:24.263116 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:56:24.268534 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:56:24.270596 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG oslo_db.sqlalchemy.engines [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:56:24.272213 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:56:24.274305 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG oslo_db.sqlalchemy.engines [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:56:24.279306 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writer thread running {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:56:24.419727 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO dbcounter [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] Registered counter for database nova_cell0 May 19 14:56:24.422750 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writer thread running {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:56:24.428727 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_db.sqlalchemy.engines [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103024) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:56:24.432961 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writer thread running {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:56:24.433212 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO dbcounter [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] Registered counter for database nova_cell0 May 19 14:56:24.442238 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG oslo_db.sqlalchemy.engines [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 14:56:24.446400 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writer thread running {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 14:56:24.765830 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 14:56:24.773084 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 14:56:24.776608 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: WARNING keystonemiddleware.auth_token [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 14:56:24.783914 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: WARNING keystonemiddleware.auth_token [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 14:56:25.114407 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 14:56:25.120696 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: WARNING keystonemiddleware.auth_token [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 14:56:25.125892 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560fa7e469c0 pid: 103024 (default app) May 19 14:56:25.127982 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:56:25.129689 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] 10.222.0.24 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002303 May 19 14:56:25.130106 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 788 bytes} [Thu May 19 14:56:25 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:56:25.130952 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: WARNING keystonemiddleware.auth_token [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 14:56:25.137058 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: WARNING keystonemiddleware.auth_token [None req-0be81598-e524-4a87-9a4b-776cf285cd1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 14:56:25.142293 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560fa7e469c0 pid: 103023 (default app) May 19 14:57:43.319679 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:57:43.320734 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 May 19 14:57:43.321283 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 2/2] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 14:57:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:57:43.339870 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_api:SELECT=3 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:43.340987 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_cell0:SELECT=3 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:43.341979 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_cell1:SELECT=3 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:43.342832 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:43.793580 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-05c55b64-bc35-4c29-9387-713f5ff1b59e admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:57:43.823104 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-05c55b64-bc35-4c29-9387-713f5ff1b59e admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.493107 May 19 14:57:43.823896 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 1/3] 10.222.0.24 () {60 vars in 1291 bytes} [Thu May 19 14:57:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:57:46.094507 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:57:46.095568 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-388d88bc-6c14-4bb0-974b-196ee6ccacb2 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 19 14:57:46.096202 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 3/4] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 14:57:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:57:46.160525 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-4ba2715b-64b3-4b28-84d8-397df81fab38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "id": "c1"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:57:46.178909 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 14:57:46.178909 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: warnings.warn(msg) May 19 14:57:46.211537 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-4ba2715b-64b3-4b28-84d8-397df81fab38 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109173 May 19 14:57:46.212769 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 2/5] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 14:57:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 14:57:46.437296 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-8090a761-2a42-44ed-8c18-24b76d0e6fba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:57:46.439733 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 14:57:46.439733 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: warnings.warn(msg) May 19 14:57:46.442429 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=3 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:46.443245 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell0:SELECT=3 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:46.444083 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell1:SELECT=3 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:46.444915 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:57:46.509552 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-8090a761-2a42-44ed-8c18-24b76d0e6fba admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288592 May 19 14:57:46.510627 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 4/6] 10.222.0.24 () {64 vars in 1335 bytes} [Thu May 19 14:57:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:57:48.778922 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-4ba2715b-64b3-4b28-84d8-397df81fab38 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:57:48.779962 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-4ba2715b-64b3-4b28-84d8-397df81fab38 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 19 14:57:48.780356 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 3/7] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 14:57:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:57:48.900485 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-bb6862ca-2fe0-4374-8d8f-26df29c67e07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512, "vcpus": 1, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:57:48.917756 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 14:57:48.917756 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: warnings.warn(msg) May 19 14:57:48.935439 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-bb6862ca-2fe0-4374-8d8f-26df29c67e07 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149276 May 19 14:57:48.936291 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 5/8] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 14:57:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 14:57:48.949039 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-be78c42f-634d-4334-ada0-27bc02c56c90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:57:48.950505 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 14:57:48.950505 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: warnings.warn(msg) May 19 14:57:48.984677 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-be78c42f-634d-4334-ada0-27bc02c56c90 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039920 May 19 14:57:48.985356 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 4/9] 10.222.0.24 () {64 vars in 1335 bytes} [Thu May 19 14:57:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:57:51.267882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-bb6862ca-2fe0-4374-8d8f-26df29c67e07 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:57:51.269427 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-bb6862ca-2fe0-4374-8d8f-26df29c67e07 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002027 May 19 14:57:51.270308 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 6/10] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 14:57:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:57:51.333962 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-ddaa7ab7-b1f8-4a26-b2a7-523f6141bb7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:57:51.355794 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-ddaa7ab7-b1f8-4a26-b2a7-523f6141bb7d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079475 May 19 14:57:51.356344 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 5/11] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 14:57:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 14:57:51.368530 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-e4aa0267-99ec-4c29-8b66-ea611adff10b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:57:51.397709 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-e4aa0267-99ec-4c29-8b66-ea611adff10b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033107 May 19 14:57:51.398431 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 7/12] 10.222.0.24 () {64 vars in 1335 bytes} [Thu May 19 14:57:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:57:53.691915 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-ddaa7ab7-b1f8-4a26-b2a7-523f6141bb7d admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:57:53.692906 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-ddaa7ab7-b1f8-4a26-b2a7-523f6141bb7d admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 May 19 14:57:53.693311 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 6/13] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 14:57:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 14:57:53.755462 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-efdb09ce-33c3-4d33-86aa-c0e9125e7d1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "id": "d3", "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:57:53.774583 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-efdb09ce-33c3-4d33-86aa-c0e9125e7d1a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075442 May 19 14:57:53.775147 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 8/14] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 14:57:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 14:57:53.787024 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-4f288a04-9220-47ef-b3dc-2b64fbd0d3d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:57:53.811860 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-4f288a04-9220-47ef-b3dc-2b64fbd0d3d3 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028494 May 19 14:57:53.812590 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 7/15] 10.222.0.24 () {64 vars in 1335 bytes} [Thu May 19 14:57:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:57:56.094881 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-efdb09ce-33c3-4d33-86aa-c0e9125e7d1a admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:57:56.096587 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-efdb09ce-33c3-4d33-86aa-c0e9125e7d1a admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 May 19 14:57:56.097079 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 9/16] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 14:57:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:57:56.158056 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-9b60160c-6c6c-4fde-ad9d-2b0dac682bf2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "name": "ds4G", "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:57:56.179305 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-9b60160c-6c6c-4fde-ad9d-2b0dac682bf2 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076170 May 19 14:57:56.183282 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 8/17] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 14:57:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 14:57:56.191989 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-c6422239-fa6d-4b26-8960-c5899acf869d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:57:56.214767 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-c6422239-fa6d-4b26-8960-c5899acf869d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026461 May 19 14:57:56.215369 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 10/18] 10.222.0.24 () {64 vars in 1335 bytes} [Thu May 19 14:57:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:57:58.500520 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-9b60160c-6c6c-4fde-ad9d-2b0dac682bf2 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:57:58.501451 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-9b60160c-6c6c-4fde-ad9d-2b0dac682bf2 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 19 14:57:58.501845 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 9/19] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 14:57:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:57:58.566637 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-5727bcbb-1189-4d3f-8ab1-12b0a2f6c37d admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:57:58.598918 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-5727bcbb-1189-4d3f-8ab1-12b0a2f6c37d admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.090508 May 19 14:57:58.599865 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 11/20] 10.222.0.24 () {60 vars in 1291 bytes} [Thu May 19 14:57:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:58:00.898933 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-9b60160c-6c6c-4fde-ad9d-2b0dac682bf2 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:00.899961 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-9b60160c-6c6c-4fde-ad9d-2b0dac682bf2 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 19 14:58:00.900369 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 10/21] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 14:58:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:58:00.967921 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-cdf1527e-0882-405a-a00b-078c150fbdfa admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:58:00.993712 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-cdf1527e-0882-405a-a00b-078c150fbdfa admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.087495 May 19 14:58:00.994247 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 12/22] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 14:58:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 14:58:01.008925 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-c3219887-abc0-4d5d-a656-6e2009fcab24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:58:01.037713 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-c3219887-abc0-4d5d-a656-6e2009fcab24 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032467 May 19 14:58:01.038391 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 11/23] 10.222.0.24 () {64 vars in 1332 bytes} [Thu May 19 14:58:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:58:03.579095 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-cdf1527e-0882-405a-a00b-078c150fbdfa admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:03.580109 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-cdf1527e-0882-405a-a00b-078c150fbdfa admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 May 19 14:58:03.580552 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 13/24] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 14:58:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:58:03.648336 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-3fe4a88b-6f99-4ae3-b038-e13b9a5e2554 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:58:03.670451 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-3fe4a88b-6f99-4ae3-b038-e13b9a5e2554 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084083 May 19 14:58:03.671269 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 12/25] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 14:58:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 14:58:03.683111 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-39088990-b126-47a9-bd26-ff473ea6a60c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:58:03.710536 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-39088990-b126-47a9-bd26-ff473ea6a60c admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031210 May 19 14:58:03.711242 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 14/26] 10.222.0.24 () {64 vars in 1332 bytes} [Thu May 19 14:58:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:58:05.981295 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-3fe4a88b-6f99-4ae3-b038-e13b9a5e2554 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:05.982306 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-3fe4a88b-6f99-4ae3-b038-e13b9a5e2554 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 19 14:58:05.982863 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 13/27] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 14:58:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:58:06.041311 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-02c45fb4-4869-4ff4-954c-d39c407bd0ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "vcpus": 2, "swap": 0, "id": "3", "disk": 40}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:58:06.058885 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-02c45fb4-4869-4ff4-954c-d39c407bd0ba admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069793 May 19 14:58:06.059467 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 15/28] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 14:58:05 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 14:58:06.070867 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-96a97f6a-5544-42db-a697-9fd3e9fb14e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:58:06.093418 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-96a97f6a-5544-42db-a697-9fd3e9fb14e7 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026124 May 19 14:58:06.093996 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 14/29] 10.222.0.24 () {64 vars in 1332 bytes} [Thu May 19 14:58:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:58:08.387277 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-02c45fb4-4869-4ff4-954c-d39c407bd0ba admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:08.388802 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-02c45fb4-4869-4ff4-954c-d39c407bd0ba admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001982 May 19 14:58:08.389972 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 16/30] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 14:58:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 14:58:08.452557 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-beba3322-5cd6-4ea6-886d-12c2c84c3311 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:58:08.471005 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-beba3322-5cd6-4ea6-886d-12c2c84c3311 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074337 May 19 14:58:08.471587 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 15/31] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 14:58:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 14:58:08.487274 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-9409cdb8-18c7-4e90-9748-07c16f831c5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:58:08.514823 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-9409cdb8-18c7-4e90-9748-07c16f831c5a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031609 May 19 14:58:08.520778 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 17/32] 10.222.0.24 () {64 vars in 1332 bytes} [Thu May 19 14:58:08 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:58:10.782123 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-beba3322-5cd6-4ea6-886d-12c2c84c3311 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:10.784474 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-beba3322-5cd6-4ea6-886d-12c2c84c3311 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002800 May 19 14:58:10.785117 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 16/33] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 14:58:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:58:10.882454 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-3176aee1-8646-4c31-b1b6-ade14b07de33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "id": "5", "vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:58:10.904174 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-3176aee1-8646-4c31-b1b6-ade14b07de33 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.112569 May 19 14:58:10.905044 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 18/34] 10.222.0.24 () {64 vars in 1282 bytes} [Thu May 19 14:58:10 2022] POST /compute/v2.1/flavors => generated 408 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 14:58:10.916921 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-fe7d2ec6-2354-4e9e-8534-9737e233998f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:58:10.940228 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-fe7d2ec6-2354-4e9e-8534-9737e233998f admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026886 May 19 14:58:10.941157 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 17/35] 10.222.0.24 () {64 vars in 1332 bytes} [Thu May 19 14:58:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:58:35.625985 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-3176aee1-8646-4c31-b1b6-ade14b07de33 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:35.627691 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-3176aee1-8646-4c31-b1b6-ade14b07de33 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001982 May 19 14:58:35.628096 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 19/36] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 14:58:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:58:35.638604 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:58:35.684686 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-b3da8a4e-ea10-4458-bdfa-e9f2fe6026d7 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:35.701737 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-b3da8a4e-ea10-4458-bdfa-e9f2fe6026d7 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067671 May 19 14:58:35.702275 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 18/37] 10.222.0.24 () {60 vars in 1291 bytes} [Thu May 19 14:58:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 14:58:36.704145 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-3176aee1-8646-4c31-b1b6-ade14b07de33 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:36.705175 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-3176aee1-8646-4c31-b1b6-ade14b07de33 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 19 14:58:36.705570 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 20/38] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 14:58:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:58:36.916594 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-cfb9d500-af15-4548-b719-d56cca012d73 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:36.922199 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.wsgi [None req-cfb9d500-af15-4548-b719-d56cca012d73 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-cfb9d500-af15-4548-b719-d56cca012d73 admin admin] Request method failure captured: May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Accept: application/json May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Accept-Encoding: gzip, deflate May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Connection: keep-alive May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Content-Length: 0 May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Host: 10.222.0.24 May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Openstack-Api-Version: compute 2.90 May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Openstack-System-Scope: None May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: User-Agent: python-novaclient May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Auth-Token: gAAAAABihlscL9qvTomZrS-qKwgPTGeIDIbMqTg4zXahiIHpwEyX4kAZ9nImOfHze23C4rzV1ZWKsxOSRzUwCMWaT54bIYpcPL_pGSBaCcZxqrtIYhRWE1TCsiC1OqFVwo8aCbFxqju63yDHN05XPSjgYWZDGkVAXj4lmOTv3F_kNoG7Rb5lRrw May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Domain-Id: None May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Domain-Name: None May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Identity-Status: Confirmed May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Is-Admin-Project: True May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Openstack-Nova-Api-Version: 2.90 May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Project-Domain-Id: default May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Project-Domain-Name: Default May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Project-Id: 55b46daee5c44a5cacdc54e48d280e5e May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Project-Name: admin May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Role: admin,member,reader May 19 14:58:36.926138 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Roles: admin,member,reader May 19 14:58:36.927649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_55b46daee5c44a5cacdc54e48d280e5e", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 14:58:36.927649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Tenant: admin May 19 14:58:36.927649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Tenant-Id: 55b46daee5c44a5cacdc54e48d280e5e May 19 14:58:36.927649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Tenant-Name: admin May 19 14:58:36.927649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-User: admin May 19 14:58:36.927649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-User-Domain-Id: default May 19 14:58:36.927649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-User-Domain-Name: Default May 19 14:58:36.927649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-User-Id: 83eec44e6acd4004ba2088801e9d8f88 May 19 14:58:36.927649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-User-Name: admin May 19 14:58:36.927649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: method: > May 19 14:58:36.927649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: exception: Flavor 42 could not be found. May 19 14:58:36.927649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: action_args: {'id': '42'} May 19 14:58:36.927649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:58:36.927649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:58:36.928519 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi May 19 14:58:36.929682 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-cfb9d500-af15-4548-b719-d56cca012d73 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:58:36.930792 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-cfb9d500-af15-4548-b719-d56cca012d73 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061843 May 19 14:58:36.930792 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 19/39] 10.222.0.24 () {60 vars in 1190 bytes} [Thu May 19 14:58:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 14:58:36.936998 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-8b698483-7ab6-45b6-be84-36a0b172e611 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:36.939957 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:58:36.959622 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-8b698483-7ab6-45b6-be84-36a0b172e611 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026079 May 19 14:58:36.960164 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 21/40] 10.222.0.24 () {60 vars in 1210 bytes} [Thu May 19 14:58:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:58:36.981993 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-39456ff2-4085-45c9-a066-6ff6f535edba admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:37.003522 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-39456ff2-4085-45c9-a066-6ff6f535edba admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025018 May 19 14:58:37.004037 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 20/41] 10.222.0.24 () {60 vars in 1210 bytes} [Thu May 19 14:58:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:58:37.013102 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-3dcdbb9a-dbad-4b8c-9a67-559cc4dfba5d admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:37.019949 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.wsgi [None req-3dcdbb9a-dbad-4b8c-9a67-559cc4dfba5d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-3dcdbb9a-dbad-4b8c-9a67-559cc4dfba5d admin admin] Request method failure captured: May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Accept: application/json May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Accept-Encoding: gzip, deflate May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Connection: keep-alive May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Content-Length: 0 May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Host: 10.222.0.24 May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Openstack-Api-Version: compute 2.90 May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Openstack-System-Scope: None May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: User-Agent: python-novaclient May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Auth-Token: gAAAAABihlscL9qvTomZrS-qKwgPTGeIDIbMqTg4zXahiIHpwEyX4kAZ9nImOfHze23C4rzV1ZWKsxOSRzUwCMWaT54bIYpcPL_pGSBaCcZxqrtIYhRWE1TCsiC1OqFVwo8aCbFxqju63yDHN05XPSjgYWZDGkVAXj4lmOTv3F_kNoG7Rb5lRrw May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Domain-Id: None May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Domain-Name: None May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Identity-Status: Confirmed May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Is-Admin-Project: True May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Openstack-Nova-Api-Version: 2.90 May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Project-Domain-Id: default May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Project-Domain-Name: Default May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Project-Id: 55b46daee5c44a5cacdc54e48d280e5e May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Project-Name: admin May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Role: admin,member,reader May 19 14:58:37.023150 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Roles: admin,member,reader May 19 14:58:37.024711 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_55b46daee5c44a5cacdc54e48d280e5e", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 14:58:37.024711 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Tenant: admin May 19 14:58:37.024711 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Tenant-Id: 55b46daee5c44a5cacdc54e48d280e5e May 19 14:58:37.024711 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Tenant-Name: admin May 19 14:58:37.024711 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-User: admin May 19 14:58:37.024711 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-User-Domain-Id: default May 19 14:58:37.024711 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-User-Domain-Name: Default May 19 14:58:37.024711 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-User-Id: 83eec44e6acd4004ba2088801e9d8f88 May 19 14:58:37.024711 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-User-Name: admin May 19 14:58:37.024711 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: method: > May 19 14:58:37.024711 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: exception: Flavor 42 could not be found. May 19 14:58:37.024711 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: action_args: {'id': '42'} May 19 14:58:37.024711 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:58:37.024711 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:58:37.025681 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi May 19 14:58:37.026752 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-3dcdbb9a-dbad-4b8c-9a67-559cc4dfba5d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:58:37.027772 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-3dcdbb9a-dbad-4b8c-9a67-559cc4dfba5d admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014988 May 19 14:58:37.027772 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 22/42] 10.222.0.24 () {60 vars in 1190 bytes} [Thu May 19 14:58:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 14:58:37.900272 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-39456ff2-4085-45c9-a066-6ff6f535edba admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:37.901268 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-39456ff2-4085-45c9-a066-6ff6f535edba admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 19 14:58:37.901662 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 21/43] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 14:58:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:58:38.088887 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-d235ccdb-507a-49b5-8055-2d9ca6256bfc admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:38.094660 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.wsgi [None req-d235ccdb-507a-49b5-8055-2d9ca6256bfc admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-d235ccdb-507a-49b5-8055-2d9ca6256bfc admin admin] Request method failure captured: May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Accept: application/json May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Accept-Encoding: gzip, deflate May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Connection: keep-alive May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Content-Length: 0 May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Host: 10.222.0.24 May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Openstack-Api-Version: compute 2.90 May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Openstack-System-Scope: None May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: User-Agent: python-novaclient May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Auth-Token: gAAAAABihlsdlrE5IEYiH6ydcrauqCTPGEyFfgnfcBwQ0-6mvUxjlZvVlATb3TQwsKsF731vhTEvTDaJIweJOccsefzGY1fNkwT-QDz55ifD79PYjaYCFgFUGbw13AECidFHLm2ea3K7TmGRrxl_smMoHjbbiWKHArucMn4IMwKWJq1XrgNbcFA May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Domain-Id: None May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Domain-Name: None May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Identity-Status: Confirmed May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Is-Admin-Project: True May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Openstack-Nova-Api-Version: 2.90 May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Project-Domain-Id: default May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Project-Domain-Name: Default May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Project-Id: 55b46daee5c44a5cacdc54e48d280e5e May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Project-Name: admin May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Role: admin,member,reader May 19 14:58:38.096642 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Roles: admin,member,reader May 19 14:58:38.097974 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_55b46daee5c44a5cacdc54e48d280e5e", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 14:58:38.097974 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Tenant: admin May 19 14:58:38.097974 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Tenant-Id: 55b46daee5c44a5cacdc54e48d280e5e May 19 14:58:38.097974 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Tenant-Name: admin May 19 14:58:38.097974 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-User: admin May 19 14:58:38.097974 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-User-Domain-Id: default May 19 14:58:38.097974 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-User-Domain-Name: Default May 19 14:58:38.097974 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-User-Id: 83eec44e6acd4004ba2088801e9d8f88 May 19 14:58:38.097974 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-User-Name: admin May 19 14:58:38.097974 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: method: > May 19 14:58:38.097974 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: exception: Flavor 84 could not be found. May 19 14:58:38.097974 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: action_args: {'id': '84'} May 19 14:58:38.097974 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:58:38.097974 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:58:38.098882 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi May 19 14:58:38.100375 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-d235ccdb-507a-49b5-8055-2d9ca6256bfc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:58:38.101646 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-d235ccdb-507a-49b5-8055-2d9ca6256bfc admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061985 May 19 14:58:38.101646 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 23/44] 10.222.0.24 () {60 vars in 1190 bytes} [Thu May 19 14:58:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 14:58:38.107560 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-b6684a97-4b2f-4e7b-92ea-5cdcd434680f admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:38.121865 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-b6684a97-4b2f-4e7b-92ea-5cdcd434680f admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017872 May 19 14:58:38.122338 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 22/45] 10.222.0.24 () {60 vars in 1210 bytes} [Thu May 19 14:58:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:58:38.131317 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-5c36fcd0-22f3-4ca9-889e-671e37b5a6c9 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:38.144530 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-5c36fcd0-22f3-4ca9-889e-671e37b5a6c9 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016613 May 19 14:58:38.145041 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 24/46] 10.222.0.24 () {60 vars in 1210 bytes} [Thu May 19 14:58:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 14:58:38.153645 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-d5e31f65-a5f7-4c67-9b7a-df662492972b admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:38.159296 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.wsgi [None req-d5e31f65-a5f7-4c67-9b7a-df662492972b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-d5e31f65-a5f7-4c67-9b7a-df662492972b admin admin] Request method failure captured: May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Accept: application/json May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Accept-Encoding: gzip, deflate May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Connection: keep-alive May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Content-Length: 0 May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Host: 10.222.0.24 May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Openstack-Api-Version: compute 2.90 May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Openstack-System-Scope: None May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: User-Agent: python-novaclient May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Auth-Token: gAAAAABihlsdlrE5IEYiH6ydcrauqCTPGEyFfgnfcBwQ0-6mvUxjlZvVlATb3TQwsKsF731vhTEvTDaJIweJOccsefzGY1fNkwT-QDz55ifD79PYjaYCFgFUGbw13AECidFHLm2ea3K7TmGRrxl_smMoHjbbiWKHArucMn4IMwKWJq1XrgNbcFA May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Domain-Id: None May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Domain-Name: None May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Identity-Status: Confirmed May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Is-Admin-Project: True May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Openstack-Nova-Api-Version: 2.90 May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Project-Domain-Id: default May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Project-Domain-Name: Default May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Project-Id: 55b46daee5c44a5cacdc54e48d280e5e May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Project-Name: admin May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Role: admin,member,reader May 19 14:58:38.160838 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Roles: admin,member,reader May 19 14:58:38.162320 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_55b46daee5c44a5cacdc54e48d280e5e", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 14:58:38.162320 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Tenant: admin May 19 14:58:38.162320 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Tenant-Id: 55b46daee5c44a5cacdc54e48d280e5e May 19 14:58:38.162320 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Tenant-Name: admin May 19 14:58:38.162320 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-User: admin May 19 14:58:38.162320 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-User-Domain-Id: default May 19 14:58:38.162320 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-User-Domain-Name: Default May 19 14:58:38.162320 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-User-Id: 83eec44e6acd4004ba2088801e9d8f88 May 19 14:58:38.162320 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-User-Name: admin May 19 14:58:38.162320 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: method: > May 19 14:58:38.162320 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: exception: Flavor 84 could not be found. May 19 14:58:38.162320 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: action_args: {'id': '84'} May 19 14:58:38.162320 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:58:38.162320 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:58:38.163438 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi May 19 14:58:38.164709 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-d5e31f65-a5f7-4c67-9b7a-df662492972b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:58:38.165948 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-d5e31f65-a5f7-4c67-9b7a-df662492972b admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011914 May 19 14:58:38.165948 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 23/47] 10.222.0.24 () {60 vars in 1190 bytes} [Thu May 19 14:58:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 14:58:39.057413 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-5c36fcd0-22f3-4ca9-889e-671e37b5a6c9 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:39.058413 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-5c36fcd0-22f3-4ca9-889e-671e37b5a6c9 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 19 14:58:39.058811 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 25/48] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 14:58:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:58:39.245514 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f86d5b92-ef02-4094-8726-bfd670f69195 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:39.253450 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.wsgi [None req-f86d5b92-ef02-4094-8726-bfd670f69195 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f86d5b92-ef02-4094-8726-bfd670f69195 admin admin] Request method failure captured: May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Accept: application/json May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Accept-Encoding: gzip, deflate May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Connection: keep-alive May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Content-Length: 0 May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Host: 10.222.0.24 May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Openstack-Api-Version: compute 2.90 May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Openstack-System-Scope: None May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: User-Agent: python-novaclient May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Auth-Token: gAAAAABihlsfH4VA9HhKv1aRYbcQ8QpLY1XF_k_dlvP6qEzrTE5e4dizhkP74bkYigh4j3jxCIuZEE5mCT_qA70xd-kOuJ-jNnJXxuMMFfH_0_zdb-ok47CirXHDbLsyRxnvlRUUL4LqZQewb1CjBPM6pMY1HhyWWrHmnNeXD_nmX0GQBNK1Ewk May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Domain-Id: None May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Domain-Name: None May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Identity-Status: Confirmed May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Is-Admin-Project: True May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Openstack-Nova-Api-Version: 2.90 May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Project-Domain-Id: default May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Project-Domain-Name: Default May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Project-Id: 55b46daee5c44a5cacdc54e48d280e5e May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Project-Name: admin May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Role: admin,member,reader May 19 14:58:39.254937 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Roles: admin,member,reader May 19 14:58:39.256499 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_55b46daee5c44a5cacdc54e48d280e5e", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 14:58:39.256499 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Tenant: admin May 19 14:58:39.256499 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Tenant-Id: 55b46daee5c44a5cacdc54e48d280e5e May 19 14:58:39.256499 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-Tenant-Name: admin May 19 14:58:39.256499 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-User: admin May 19 14:58:39.256499 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-User-Domain-Id: default May 19 14:58:39.256499 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-User-Domain-Name: Default May 19 14:58:39.256499 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-User-Id: 83eec44e6acd4004ba2088801e9d8f88 May 19 14:58:39.256499 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: X-User-Name: admin May 19 14:58:39.256499 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: method: > May 19 14:58:39.256499 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: exception: Flavor 451 could not be found. May 19 14:58:39.256499 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: action_args: {'id': '451'} May 19 14:58:39.256499 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:58:39.256499 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:58:39.257457 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: ERROR nova.api.openstack.wsgi May 19 14:58:39.258575 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f86d5b92-ef02-4094-8726-bfd670f69195 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:58:39.259658 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-f86d5b92-ef02-4094-8726-bfd670f69195 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061569 May 19 14:58:39.259658 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 24/49] 10.222.0.24 () {60 vars in 1193 bytes} [Thu May 19 14:58:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 14:58:39.265731 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-30f80e9e-5bbb-4cbc-bd81-490fcf627bf2 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:39.279141 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-30f80e9e-5bbb-4cbc-bd81-490fcf627bf2 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016938 May 19 14:58:39.279680 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 26/50] 10.222.0.24 () {60 vars in 1210 bytes} [Thu May 19 14:58:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:58:39.288471 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f49b3888-ea8f-4a77-8dcc-2b028ac516e2 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:39.302241 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-f49b3888-ea8f-4a77-8dcc-2b028ac516e2 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017183 May 19 14:58:39.302755 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 25/51] 10.222.0.24 () {60 vars in 1210 bytes} [Thu May 19 14:58:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:58:39.311574 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-7cfb60a1-f1be-401a-af46-d50c563026b1 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:39.317604 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.wsgi [None req-7cfb60a1-f1be-401a-af46-d50c563026b1 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-7cfb60a1-f1be-401a-af46-d50c563026b1 admin admin] Request method failure captured: May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Accept: application/json May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Accept-Encoding: gzip, deflate May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Connection: keep-alive May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Content-Length: 0 May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Host: 10.222.0.24 May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Openstack-Api-Version: compute 2.90 May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Openstack-System-Scope: None May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: User-Agent: python-novaclient May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Auth-Token: gAAAAABihlsfH4VA9HhKv1aRYbcQ8QpLY1XF_k_dlvP6qEzrTE5e4dizhkP74bkYigh4j3jxCIuZEE5mCT_qA70xd-kOuJ-jNnJXxuMMFfH_0_zdb-ok47CirXHDbLsyRxnvlRUUL4LqZQewb1CjBPM6pMY1HhyWWrHmnNeXD_nmX0GQBNK1Ewk May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Domain-Id: None May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Domain-Name: None May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Identity-Status: Confirmed May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Is-Admin-Project: True May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Openstack-Nova-Api-Version: 2.90 May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Project-Domain-Id: default May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Project-Domain-Name: Default May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Project-Id: 55b46daee5c44a5cacdc54e48d280e5e May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Project-Name: admin May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Role: admin,member,reader May 19 14:58:39.319078 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Roles: admin,member,reader May 19 14:58:39.320739 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_55b46daee5c44a5cacdc54e48d280e5e", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/55b46daee5c44a5cacdc54e48d280e5e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 14:58:39.320739 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Tenant: admin May 19 14:58:39.320739 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Tenant-Id: 55b46daee5c44a5cacdc54e48d280e5e May 19 14:58:39.320739 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-Tenant-Name: admin May 19 14:58:39.320739 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-User: admin May 19 14:58:39.320739 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-User-Domain-Id: default May 19 14:58:39.320739 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-User-Domain-Name: Default May 19 14:58:39.320739 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-User-Id: 83eec44e6acd4004ba2088801e9d8f88 May 19 14:58:39.320739 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: X-User-Name: admin May 19 14:58:39.320739 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: method: > May 19 14:58:39.320739 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: exception: Flavor 451 could not be found. May 19 14:58:39.320739 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: action_args: {'id': '451'} May 19 14:58:39.320739 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:58:39.320739 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:58:39.321700 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: ERROR nova.api.openstack.wsgi May 19 14:58:39.323005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-7cfb60a1-f1be-401a-af46-d50c563026b1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103024) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:58:39.324404 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-7cfb60a1-f1be-401a-af46-d50c563026b1 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012335 May 19 14:58:39.324404 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 27/52] 10.222.0.24 () {60 vars in 1193 bytes} [Thu May 19 14:58:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 19 14:58:40.222374 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f49b3888-ea8f-4a77-8dcc-2b028ac516e2 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:40.223402 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-f49b3888-ea8f-4a77-8dcc-2b028ac516e2 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 19 14:58:40.223822 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 26/53] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 14:58:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:58:40.413600 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-a572a3df-8a2c-4fbb-a05f-6d9a356898e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:58:40.436321 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-a572a3df-8a2c-4fbb-a05f-6d9a356898e8 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.074659 May 19 14:58:40.436797 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 28/54] 10.222.0.24 () {64 vars in 1235 bytes} [Thu May 19 14:58:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 14:58:41.315212 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f49b3888-ea8f-4a77-8dcc-2b028ac516e2 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:41.316229 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-f49b3888-ea8f-4a77-8dcc-2b028ac516e2 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 19 14:58:41.316629 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 27/55] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 14:58:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:58:41.510969 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-bbffece4-e9df-4990-a1e9-903051c3fea7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:58:41.528274 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-bbffece4-e9df-4990-a1e9-903051c3fea7 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068829 May 19 14:58:41.528745 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 29/56] 10.222.0.24 () {64 vars in 1235 bytes} [Thu May 19 14:58:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 14:58:42.416683 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f49b3888-ea8f-4a77-8dcc-2b028ac516e2 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:42.417680 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-f49b3888-ea8f-4a77-8dcc-2b028ac516e2 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 19 14:58:42.418077 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 28/57] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 14:58:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:58:42.605894 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-e889a3fc-f2d4-4135-a60b-1dce3b8cdd0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:58:42.624047 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-e889a3fc-f2d4-4135-a60b-1dce3b8cdd0f admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068934 May 19 14:58:42.624572 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 30/58] 10.222.0.24 () {64 vars in 1235 bytes} [Thu May 19 14:58:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 14:58:43.509007 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f49b3888-ea8f-4a77-8dcc-2b028ac516e2 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:43.510000 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-f49b3888-ea8f-4a77-8dcc-2b028ac516e2 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 19 14:58:43.510393 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 29/59] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 14:58:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:58:43.694650 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-5aa1c41d-0d79-458e-a8dc-a3f557b52b69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:58:43.712389 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-5aa1c41d-0d79-458e-a8dc-a3f557b52b69 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067586 May 19 14:58:43.712924 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 31/60] 10.222.0.24 () {64 vars in 1235 bytes} [Thu May 19 14:58:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 14:58:44.609429 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f49b3888-ea8f-4a77-8dcc-2b028ac516e2 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:44.610454 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-f49b3888-ea8f-4a77-8dcc-2b028ac516e2 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 May 19 14:58:44.610853 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 30/61] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 14:58:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:58:44.803526 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-970b8d0f-a25f-4ea7-ae89-542ba5659528 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:58:44.822915 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-970b8d0f-a25f-4ea7-ae89-542ba5659528 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070727 May 19 14:58:44.823425 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 32/62] 10.222.0.24 () {60 vars in 1202 bytes} [Thu May 19 14:58:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:59:46.874225 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-f49b3888-ea8f-4a77-8dcc-2b028ac516e2 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:59:46.875250 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-f49b3888-ea8f-4a77-8dcc-2b028ac516e2 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 May 19 14:59:46.875653 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 31/63] 10.222.0.24 () {54 vars in 930 bytes} [Thu May 19 14:59:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:59:46.886937 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:59:46.933386 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-8dc96098-9a16-4f61-8929-a3a0bdc614a2 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:59:46.953159 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-8dc96098-9a16-4f61-8929-a3a0bdc614a2 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071242 May 19 14:59:46.953698 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 33/64] 10.222.0.24 () {60 vars in 1291 bytes} [Thu May 19 14:59:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:59:46.982546 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG dbcounter [-] [103023] Writing DB stats nova_api:SELECT=14 {{(pid=103023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:59:46.985241 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-cf270668-5dbb-428d-bde4-fe1b8d62ec65 admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:59:46.992883 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-cf270668-5dbb-428d-bde4-fe1b8d62ec65 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013158 May 19 14:59:46.993407 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 32/65] 10.222.0.24 () {60 vars in 1282 bytes} [Thu May 19 14:59:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:59:47.006890 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-e53dece0-4f35-46a8-bdd0-ae7fab91baa7 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:59:47.016220 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-e53dece0-4f35-46a8-bdd0-ae7fab91baa7 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013400 May 19 14:59:47.017327 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 34/66] 10.222.0.24 () {60 vars in 1285 bytes} [Thu May 19 14:59:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:59:47.028649 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-7883014f-4989-425f-924a-9285b009c5ac admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:59:47.036240 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-7883014f-4989-425f-924a-9285b009c5ac admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011165 May 19 14:59:47.036754 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 33/67] 10.222.0.24 () {60 vars in 1285 bytes} [Thu May 19 14:59:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:59:47.047919 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-84cb35c2-dad7-4457-82c8-148effae88e2 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:59:47.055484 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-84cb35c2-dad7-4457-82c8-148effae88e2 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011163 May 19 14:59:47.056005 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 35/68] 10.222.0.24 () {60 vars in 1282 bytes} [Thu May 19 14:59:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:03:26.990018 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-7883014f-4989-425f-924a-9285b009c5ac admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:03:26.991020 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-7883014f-4989-425f-924a-9285b009c5ac admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 19 15:03:26.991453 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 34/69] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 15:03:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:03:27.148708 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=6 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:03:27.261821 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-971d6441-f2c8-44bf-91a3-11640a5515a1 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:03:27.263026 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 15:03:27.263026 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: warnings.warn(msg) May 19 15:03:27.264311 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-971d6441-f2c8-44bf-91a3-11640a5515a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:03:27.264868 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-971d6441-f2c8-44bf-91a3-11640a5515a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:03:27.265676 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-971d6441-f2c8-44bf-91a3-11640a5515a1 admin admin] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:03:27.266126 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-971d6441-f2c8-44bf-91a3-11640a5515a1 admin admin] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:03:27.300092 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-971d6441-f2c8-44bf-91a3-11640a5515a1 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.152746 May 19 15:03:27.300658 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 36/70] 10.222.0.24 () {60 vars in 1193 bytes} [Thu May 19 15:03:27 2022] GET /compute/v2.1/os-services => generated 794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 15:03:28.204580 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-7883014f-4989-425f-924a-9285b009c5ac admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:03:28.205604 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-7883014f-4989-425f-924a-9285b009c5ac admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 19 15:03:28.205996 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 35/71] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 15:03:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:03:28.399685 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-b427a227-5c6a-4a1c-9962-f7fe470b90c5 admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:03:28.400869 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 15:03:28.400869 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: warnings.warn(msg) May 19 15:03:28.402026 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-b427a227-5c6a-4a1c-9962-f7fe470b90c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:03:28.402461 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-b427a227-5c6a-4a1c-9962-f7fe470b90c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:03:28.403295 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-b427a227-5c6a-4a1c-9962-f7fe470b90c5 admin admin] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:03:28.403713 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-b427a227-5c6a-4a1c-9962-f7fe470b90c5 admin admin] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:03:28.425059 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-b427a227-5c6a-4a1c-9962-f7fe470b90c5 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.081562 May 19 15:03:28.425799 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 37/72] 10.222.0.24 () {60 vars in 1193 bytes} [Thu May 19 15:03:28 2022] GET /compute/v2.1/os-services => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 15:03:39.759655 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-7883014f-4989-425f-924a-9285b009c5ac admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:03:39.760719 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-7883014f-4989-425f-924a-9285b009c5ac admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 19 15:03:39.761137 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 36/73] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 15:03:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:03:39.905709 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell0:SELECT=4 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:03:39.906431 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_cell1:SELECT=4 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:03:39.907037 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG dbcounter [-] [103024] Writing DB stats nova_api:SELECT=8 {{(pid=103024) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:03:39.954472 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-06218c80-8bd1-40a7-a7c9-ce94255a0d7d admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:03:39.955673 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 15:03:39.955673 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: warnings.warn(msg) May 19 15:03:39.956853 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-06218c80-8bd1-40a7-a7c9-ce94255a0d7d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:03:39.957296 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-06218c80-8bd1-40a7-a7c9-ce94255a0d7d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:03:39.958077 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-06218c80-8bd1-40a7-a7c9-ce94255a0d7d admin admin] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:03:39.958514 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-06218c80-8bd1-40a7-a7c9-ce94255a0d7d admin admin] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:03:39.983694 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-06218c80-8bd1-40a7-a7c9-ce94255a0d7d admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.082824 May 19 15:03:39.984177 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 38/74] 10.222.0.24 () {60 vars in 1193 bytes} [Thu May 19 15:03:39 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:03:40.876503 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: DEBUG nova.api.openstack.wsgi [None req-7883014f-4989-425f-924a-9285b009c5ac admin admin] Calling method '>' {{(pid=103023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:03:40.877536 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: INFO nova.api.openstack.requestlog [None req-7883014f-4989-425f-924a-9285b009c5ac admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 19 15:03:40.877934 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: [pid: 103023|app: 0|req: 37/75] 10.222.0.24 () {56 vars in 1074 bytes} [Thu May 19 15:03:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:03:41.063919 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG nova.api.openstack.wsgi [None req-6ea2d6f4-d9d1-4022-8403-efb894ea8a0a admin admin] Calling method '>' {{(pid=103024) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:03:41.065069 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 15:03:41.065069 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: warnings.warn(msg) May 19 15:03:41.066239 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-6ea2d6f4-d9d1-4022-8403-efb894ea8a0a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:03:41.066677 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-6ea2d6f4-d9d1-4022-8403-efb894ea8a0a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:03:41.067500 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-6ea2d6f4-d9d1-4022-8403-efb894ea8a0a admin admin] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:03:41.067924 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: DEBUG oslo_concurrency.lockutils [None req-6ea2d6f4-d9d1-4022-8403-efb894ea8a0a admin admin] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103024) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:03:41.089621 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: INFO nova.api.openstack.requestlog [None req-6ea2d6f4-d9d1-4022-8403-efb894ea8a0a admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.076635 May 19 15:03:41.090098 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: [pid: 103024|app: 0|req: 39/76] 10.222.0.24 () {60 vars in 1193 bytes} [Thu May 19 15:03:41 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:04:38.234776 dv-cinder-825492-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 19 15:04:38.235981 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: Thu May 19 15:04:38 2022 - graceful shutdown triggered... May 19 15:04:38.236494 dv-cinder-825492-12-iscsi devstack@n-api.service[103024]: Gracefully killing worker 2 (pid: 103024)... May 19 15:04:38.236861 dv-cinder-825492-12-iscsi devstack@n-api.service[103023]: Gracefully killing worker 1 (pid: 103023)... May 19 15:04:39.237103 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: worker 1 buried after 1 seconds May 19 15:04:39.237504 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: worker 2 buried after 1 seconds May 19 15:04:39.237504 dv-cinder-825492-12-iscsi devstack@n-api.service[103022]: goodbye to uWSGI. May 19 15:04:39.238674 dv-cinder-825492-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 19 15:04:39.239266 dv-cinder-825492-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 19 15:04:39.242008 dv-cinder-825492-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 15:04:39.260653 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 15:04:39.281027 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 15:04:39 2022] *** May 19 15:04:39.281027 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 15:04:39.281027 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 15:04:39.281027 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: nodename: dv-cinder-825492-12-iscsi May 19 15:04:39.281027 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: machine: x86_64 May 19 15:04:39.281027 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: clock source: unix May 19 15:04:39.281027 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: pcre jit disabled May 19 15:04:39.281027 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: detected number of CPU cores: 4 May 19 15:04:39.281027 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: current working directory: / May 19 15:04:39.281027 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: detected binary path: /usr/bin/uwsgi-core May 19 15:04:39.281027 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: your processes number limit is 47680 May 19 15:04:39.281027 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: your memory page size is 4096 bytes May 19 15:04:39.281027 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: detected max file descriptor number: 2048 May 19 15:04:39.281027 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: lock engine: pthread robust mutexes May 19 15:04:39.281960 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: thunder lock: enabled May 19 15:04:39.281960 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 15:04:39.281960 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 15:04:39.326883 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: Python main interpreter initialized at 0x55e0c3cd89c0 May 19 15:04:39.326883 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: python threads support enabled May 19 15:04:39.326883 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: your server socket listen backlog is limited to 100 connections May 19 15:04:39.326883 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: your mercy for graceful operations on workers is 90 seconds May 19 15:04:39.327311 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: mapped 403077 bytes (393 KB) for 2 cores May 19 15:04:39.327407 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: *** Operational MODE: preforking *** May 19 15:04:39.327614 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: *** uWSGI is running in multiple interpreter mode *** May 19 15:04:39.327614 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: spawned uWSGI master process (pid: 117429) May 19 15:04:39.327821 dv-cinder-825492-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 15:04:39.335224 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: spawned uWSGI worker 1 (pid: 117444, cores: 1) May 19 15:04:39.335224 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: spawned uWSGI worker 2 (pid: 117445, cores: 1) May 19 15:04:39.335224 dv-cinder-825492-12-iscsi devstack@n-api.service[117429]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 15:04:40.544861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 15:04:40.586494 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 15:04:41.344486 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 15:04:41.344486 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: from cryptography.utils import int_from_bytes May 19 15:04:41.344811 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 15:04:41.344811 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: from cryptography.utils import int_from_bytes May 19 15:04:41.397832 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 15:04:41.397832 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: from cryptography.utils import int_from_bytes May 19 15:04:41.398221 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 15:04:41.398221 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: from cryptography.utils import int_from_bytes May 19 15:04:43.755726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 15:04:43.756270 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 15:04:43.756530 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 15:04:43.756896 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 15:04:43.757153 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 15:04:43.757546 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.757876 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.758207 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.758530 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.758860 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.759173 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.759525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.759876 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.760209 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.760471 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.760788 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.761114 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-12-iscsi {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.761441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.761749 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.762062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.762381 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.762688 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.763014 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.763345 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.763853 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.764298 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.764609 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.764925 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.765268 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.765587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.765905 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.766227 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.766538 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.766867 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.767193 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.767607 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-12-iscsi {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.767917 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.768230 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.768546 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.768959 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.769275 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.769600 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.769909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.770233 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.770544 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.770873 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.771205 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.771539 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.771859 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.772162 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.772474 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.772785 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.773106 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.773411 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.773719 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.773971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.774278 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.774599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.774924 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.775291 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.775548 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.775804 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.776123 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.776443 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.776753 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.777066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.777374 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.777682 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.778011 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.779013 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.779013 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.779013 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.779526 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.779680 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.779899 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.780201 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.780541 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.780943 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.781196 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.781506 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.781849 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.782169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.782478 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.782799 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.783122 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.783448 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.783750 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.784064 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.784381 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.784716 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.785020 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.785272 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.785593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.785907 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.786226 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.786554 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.786863 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.787173 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.787518 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.787826 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.788133 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.788457 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.788766 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.789073 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.789399 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.789704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.790010 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.790469 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.790662 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.791543 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.791857 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.792167 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.792476 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.792783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.793105 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.793413 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.793720 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.794061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.794348 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.794654 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.794972 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.795304 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.795613 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.795936 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.796238 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.796546 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.796864 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.797172 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.797479 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.797782 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.798087 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.798391 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.798697 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.799003 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.799327 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.799629 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.799950 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.800273 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.800581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.800893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.801200 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.801520 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.801859 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.802192 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.802537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.802853 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.803187 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.803537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.803856 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.804183 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.804484 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.804810 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.805122 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.805435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.805743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.806062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.806385 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.807294 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.807608 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.807926 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.808246 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.808560 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.808879 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.809208 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.809530 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.809844 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.810187 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.810532 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.810846 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.811172 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.811516 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.811833 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.812145 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.812458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.812804 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.813614 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.813614 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.813891 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.814076 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.814393 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.814703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.815017 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.815352 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.815694 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.816004 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.816725 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.816725 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.818038 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.818038 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.818038 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.818038 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.818432 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.818432 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.818709 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.819019 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.819371 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.819699 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.820030 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.820342 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.820708 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.821002 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.821335 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.821648 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.821963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.822306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.822621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.822935 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.823273 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.823602 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.823917 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.824226 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.824553 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.824858 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.825165 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.825482 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.825801 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.826116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.826438 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.826751 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.827081 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.827423 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.827737 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.828073 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.828408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.828717 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.829043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.829371 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.829688 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.829994 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.830306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.830614 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.831348 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.831348 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.831536 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.831628 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 15:04:43.832041 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.832128 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 15:04:43.832221 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.832332 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 15:04:43.832439 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.832691 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.832789 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 15:04:43.832947 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 15:04:43.833037 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.833304 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.833461 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.833615 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.833719 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.833920 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.834019 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.834222 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.834323 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.834535 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.834679 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.834871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.834975 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.835178 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.835300 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.835519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.835618 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.835854 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.835986 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.836117 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.836226 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.836436 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.836537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.836763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-12-iscsi {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.836854 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.837087 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.837186 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.837393 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.837530 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.837723 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.837827 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.838046 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.838179 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.838348 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.838488 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.838671 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.838773 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.838978 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.839069 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.839322 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.839513 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.839623 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.839828 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.839949 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.840131 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.840262 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.840441 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.840583 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.840779 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.840878 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.841126 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.841228 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.841387 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.841515 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.841706 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.841848 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.842014 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.842167 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.842337 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.842490 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.842646 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.842804 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.843045 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-12-iscsi {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.843139 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.843386 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.843491 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.843698 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.843792 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.844012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.844117 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.844342 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.844446 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.844665 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.844809 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.844980 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.845210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.845307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.845411 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.845624 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.845740 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.845937 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.846051 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.846269 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.846375 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.846596 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.846710 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.846897 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.847014 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.847234 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.847362 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.847531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.847641 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.847837 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.847956 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.848159 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.848280 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.848468 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.848577 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.848775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.848894 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.849081 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.849192 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.849339 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.849463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.849650 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.849758 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.849951 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.850054 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.850275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.850387 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.850609 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.850720 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.850872 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.850984 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.851065 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.851333 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.851453 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.851540 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.851767 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.851869 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.852022 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.852131 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.852334 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.852612 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.852765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.852916 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.853061 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.853247 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.853906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.854000 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.854092 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.854183 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.854332 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.854495 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.854648 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.854798 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.854937 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.855079 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.855263 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.855436 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.855578 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.855680 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.855888 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.855983 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.856209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.856317 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.856605 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.856710 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.856856 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.857350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.857450 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.857551 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.857647 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.857733 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.857824 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.857915 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.858066 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.858173 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.858387 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.858492 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.858707 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.858923 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.859081 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.859311 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.859467 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.859574 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.859662 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.859754 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.859920 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.860016 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.860259 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.860409 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.860564 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.860664 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.860828 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.860969 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.861172 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.861317 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.861496 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.861660 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.861814 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.861909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.861993 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.862162 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.862288 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.862505 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.863042 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.863140 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.863361 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.863517 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.863661 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.863661 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.863953 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.864055 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.864148 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.864255 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.864348 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.864476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.864638 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.864741 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.864942 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.865064 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.865256 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.865389 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.865553 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.865702 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.865872 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.866036 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.866192 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.866361 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.866502 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.866683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.866796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.867022 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.867145 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.867372 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.867483 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.867720 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.867815 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.868025 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.868119 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.868332 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.868434 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.868637 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.868728 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.868962 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.869653 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.869790 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.869947 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.870088 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.870229 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.870378 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.870547 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.870699 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.870844 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.870993 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.871414 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.871563 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.871667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.871869 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.871969 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.872172 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.872272 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.872478 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.872593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.872787 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.872934 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.873075 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.873171 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.873383 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.873484 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.873689 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.873804 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.873992 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.874094 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.874294 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.874397 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.874598 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.874700 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.874897 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.875006 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.875215 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.875322 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.875549 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.875643 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.875857 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.875957 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.876167 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.876321 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.876467 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.876620 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.876770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 15:04:43.876912 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.877096 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.877239 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.877427 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.877522 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.877756 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.877860 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.878063 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.878161 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.878369 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.878469 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.878675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.878779 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.878989 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.879081 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.879323 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.879417 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.879632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.879739 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.879948 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.880047 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.880260 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.880359 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.880571 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.880663 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.880878 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.880968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.881183 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.881275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.881496 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.881603 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.881803 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.881894 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.882117 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.882216 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.882427 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.882525 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.882729 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.882835 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.883034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.883182 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.883350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.883450 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.883667 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.883767 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.883970 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.884077 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.884282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.884381 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.884609 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.884705 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.884928 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.885029 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.885235 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.885373 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.885543 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.885644 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.885844 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.885955 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.886155 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.886255 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.886467 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.886565 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.886772 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.886873 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.887093 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.887183 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.887427 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.887575 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.887733 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.887884 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.888050 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.888149 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.888353 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.888525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.888645 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.888755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.888964 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.889085 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.889276 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.889400 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.889589 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.889718 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.889906 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.890023 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.890211 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.890329 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.890522 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.890649 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.890828 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.890955 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.891133 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.891284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.891543 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.891699 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.891823 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.891940 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.892051 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.892168 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.892448 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.892592 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.892712 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.892942 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.893255 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.893646 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.893777 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.893895 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.894006 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.894192 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.894312 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.894498 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.894641 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.894956 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.895076 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.895171 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.895416 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.895531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.895627 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.895755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.895931 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.896067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.896282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.896375 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.896591 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.896682 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.896963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.897055 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.897267 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.897359 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.897586 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.897676 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.897897 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.897995 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.898206 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.898310 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.898518 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.898608 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.898824 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.898923 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.899129 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.899240 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.899469 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.899559 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.899781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.899894 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.900095 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.900214 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.900428 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.900522 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.900739 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.900884 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.901066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.901192 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.901383 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.901485 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.901694 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.901794 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.902016 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.902116 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.902342 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.902435 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.902647 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.902774 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.902960 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.903059 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.903301 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.903456 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.903620 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.903775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.903920 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.904020 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.904229 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.904319 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.904533 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.904626 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.904837 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.904930 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.905143 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.905235 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.905453 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.905591 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.905756 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.905855 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.906059 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.906166 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.906363 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.906464 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.906667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.906769 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.906971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.907077 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.907315 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.907423 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.907626 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.907722 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.907933 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.908042 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.908235 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.908327 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.908540 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.908639 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.908846 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.908946 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.909161 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.909252 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.909467 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.909565 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.909825 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.909917 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.910150 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.910306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.910474 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.910568 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.910790 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.910883 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.911100 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.911191 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.911438 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.911531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.911753 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.911845 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.912066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.912157 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.912372 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.912463 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.912695 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.912838 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.913008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.913101 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.913330 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.913503 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.913715 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.913819 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.913945 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.914044 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.914253 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.914355 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.914562 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.914653 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.914865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.914963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.915180 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.915386 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.915506 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.915597 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.916301 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.916533 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.916663 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.916766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.916977 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.917123 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.917287 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.917415 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.917604 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.917732 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.918577 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.918727 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.918846 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.918964 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.919084 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.919227 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.919358 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.919478 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.919588 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.919696 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.919813 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.919924 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.920032 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.920139 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.920248 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.920364 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.920544 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.920658 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.920767 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.920942 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.921062 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.921252 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.921399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.921566 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.921657 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.921892 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.921981 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.922207 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.922299 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.922520 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.922619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.922826 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.922974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.923145 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.923257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.923495 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.923590 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.923811 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.923906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.924134 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.924217 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.924480 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.924560 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.924790 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.924871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.925099 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.925189 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.925414 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.925497 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.925773 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.925883 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.926033 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.926123 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.926337 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.926420 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.926654 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.926750 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.926957 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.927044 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.927648 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.927787 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.927901 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.928098 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.928213 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.928321 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.928430 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.928546 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.928662 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.928809 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.928809 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.929162 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.929281 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.929398 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.929522 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.929641 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.929751 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.929861 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.929976 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.930093 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.930273 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.930412 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.930581 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.930697 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.930884 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.931005 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.931188 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.931363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.932083 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.932404 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.932603 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.932747 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.933011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.933154 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.933333 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.933608 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.933753 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.933982 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.934123 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.934254 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.934431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.934564 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.934843 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.934990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.935157 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.935402 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.935538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.935791 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.935978 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.936122 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.936316 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.936450 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.936722 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.936854 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.937051 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.937315 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.937699 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.937699 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.937958 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.938088 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.938227 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.938366 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.938548 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.938726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.938874 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.939169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.939449 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.939643 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.939777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.940091 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.940224 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.940412 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.940573 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.940742 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.941002 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.941135 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.941464 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.941646 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.941806 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.941946 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.942075 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.942344 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.942517 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.942659 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.942947 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.943100 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.943402 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.943551 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.943697 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.943891 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.944111 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.944245 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.944373 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.944516 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.944739 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.944880 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.945041 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.945232 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.945376 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.945634 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.945765 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.945938 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.946142 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.946283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.946542 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.946683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.946855 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.947061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.947235 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.947675 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.947914 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.948051 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.948181 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.948309 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.948437 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.948573 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.948714 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.948898 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.949033 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.949324 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.949472 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.949662 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.949843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.949985 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.950291 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.950433 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.950625 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.950797 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.950940 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.951305 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.951470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.951604 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.951739 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.951883 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.952153 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.952292 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.952465 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.952761 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.952895 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.953066 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.953255 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.953402 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.953675 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.953811 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.954030 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.954252 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.954388 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.954570 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.954703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.954880 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.955077 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.955260 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.955508 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.955642 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.955817 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.956010 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.956159 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.956409 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.956541 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.956719 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.956940 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.957083 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.957319 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.957628 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.957930 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.958147 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.958289 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.958434 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.958565 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.958701 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.958839 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.959070 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.959245 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.959471 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.959605 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.959735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.959998 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.960131 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.960324 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.960532 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.960664 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.960912 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.961057 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.961224 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.961443 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.961600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.961822 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.961964 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.962126 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.962311 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.962450 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.962765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.962936 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.963072 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.963401 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.963575 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.963788 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.963932 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.964146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.964366 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.964509 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.964649 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.964835 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.964977 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.965165 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.965306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.965468 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.965755 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.965890 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.966058 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.966242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.966376 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.966667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.966808 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.966976 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.967186 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.967359 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.967596 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.967730 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.968021 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.968257 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.969134 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.969134 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.969402 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.969624 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.969758 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.970075 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.970263 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.970407 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.970695 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.970827 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.971000 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.971228 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.971385 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.971647 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.971799 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.971958 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.972163 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.972296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.972557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.972691 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.972877 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.973190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.973323 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.973501 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.973681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.973891 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.974177 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.974344 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.974550 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.974692 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.974825 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.975026 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.975159 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.975380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.975556 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.975700 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.975990 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.976131 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.976299 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.976502 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.976644 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.976911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.977054 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.977225 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.977523 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.977656 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.977835 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.978134 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.978279 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.979031 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.979318 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.979498 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.979688 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.979897 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.980040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.980180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.980320 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.980450 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.980716 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.980858 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.981056 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.981235 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.981370 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.981712 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.981871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.982088 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.982224 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.982403 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.982591 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.982725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.983008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.983141 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.983359 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.983629 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.983775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.983993 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.984135 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.984286 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.984581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.984724 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.984959 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.985104 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.985280 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.985457 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.985599 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.985889 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.986023 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.986193 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.986376 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.986510 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.986793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.986924 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.987115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.987374 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.987511 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.987734 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.988019 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.988307 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.988458 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.988672 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.988811 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.988945 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.989203 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.989334 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.989478 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.989645 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.989976 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.990122 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.990326 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.990469 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.990647 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.990828 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.990962 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.991296 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.991449 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.991678 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.991916 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.992052 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.992190 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.992320 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.992528 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.992669 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.992838 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.993103 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.993244 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.993471 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.993689 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.993838 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.994719 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.994910 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.995047 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.995177 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.995360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.995573 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.995707 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.995887 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.996112 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.996511 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.996811 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.996956 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.997188 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:43.997321 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.003235 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.003729 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.003916 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.004070 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.004235 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.004371 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.004512 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.004645 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.007361 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.007522 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.007670 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.007813 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.007954 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.008094 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.008237 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.008370 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.008502 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.008640 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.008778 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.008909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.009052 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.009183 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.009320 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.009466 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.009677 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.009945 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.010117 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.010259 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.010391 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.010520 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.010650 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.010793 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.010941 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.010941 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.011214 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.011379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.011511 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.011651 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.011789 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.011919 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.012056 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.012193 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.012324 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.012462 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.012462 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.012716 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.012845 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.012974 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.013111 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.013111 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.013357 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.013357 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.013607 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.013607 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.013607 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.015315 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.015472 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.015612 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.015752 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.015892 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.016037 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.016169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.016298 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.016298 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.016558 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.016701 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.016701 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.016965 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.017094 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.017094 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.017346 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.017489 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.017619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.017748 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.017748 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.017992 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.018121 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.018121 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.022646 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.022790 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.022790 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.023046 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.023181 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.023368 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.023503 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.023503 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.023756 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.023895 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.023895 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.024176 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.024335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.024464 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.024593 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.024593 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.024859 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.025004 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.025004 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.025821 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.025961 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.025961 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.026223 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.026363 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.026502 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.026640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.026640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.026901 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.027045 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.027187 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.027369 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.027369 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.027626 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.027766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.027766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.028013 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.028143 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.028143 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.028408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.028549 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.028679 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.028816 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.028946 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.029074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.029209 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.029348 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.029348 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.029594 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.029722 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.029858 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.029858 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.030115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.030254 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.030391 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.030523 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.030659 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.030866 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.031007 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.031138 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.031301 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.031433 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.031565 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.031706 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.031838 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.031963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.032083 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.032083 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.032083 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.032083 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.032508 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.032638 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.032766 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.032908 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.032908 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.033163 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.033292 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.033292 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.034378 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.034519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.034519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.034519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.034915 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.035045 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.035045 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.035045 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.035045 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.035649 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.035789 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.035789 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.035789 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.035789 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.036286 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.036424 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.036424 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.036424 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.036424 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.036902 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.037034 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.037034 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.037034 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.037034 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.037546 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.037677 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.037677 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.037677 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.037677 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.038140 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.038260 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.038260 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.038260 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.038560 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.038679 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.038679 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.038905 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.039017 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.039133 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.039275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.039275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.039275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.039275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.039275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.039275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.039275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.039275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.040207 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.040344 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.040548 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.040548 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.040548 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.041482 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.041625 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.041826 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.041826 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.042099 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.042099 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.042342 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.042481 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.042481 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.042481 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.042854 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.042985 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.043128 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.043294 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.043294 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.043294 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.043294 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.043294 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.044953 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.045082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.045082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.045082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.045082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.045570 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.045697 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.045697 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.045697 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.045697 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.045697 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.045697 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.046320 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.046320 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.046534 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.046813 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.048089 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.048089 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.048089 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.048089 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.048629 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.048629 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.050213 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.050369 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.050369 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.050369 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.050743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.050743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.050743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.051134 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.051134 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.051472 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.051601 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.051814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.052212 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.052345 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.052606 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.052927 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.053258 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.053400 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.053578 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.053861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.054618 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.054883 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.054883 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.055277 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.055411 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.055546 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.055682 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.055939 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.056085 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.056376 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.056539 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.056759 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.056981 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.057115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.057433 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.057568 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.057746 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.057922 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.058056 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.058357 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.058504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.058898 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.059113 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.059467 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.059668 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.059802 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.060093 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.060234 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.060410 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.060669 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.060806 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.061028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.061205 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.061346 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.061641 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.061773 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.061961 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.062143 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.062278 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.062571 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.062704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.063008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.063159 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.063332 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.063608 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.063790 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.063957 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.064256 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.064532 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.064532 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.065131 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.065338 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.065482 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.065613 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.065613 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.065879 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.066115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.066115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.066411 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.066542 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.066841 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.066978 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.067109 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.067296 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.067722 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.067855 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.068230 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.068379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.068585 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.068752 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.068866 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.068991 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.069195 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.069514 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.069654 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.069873 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.070109 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.070256 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.070475 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.070758 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.070944 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.071086 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.071315 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.071469 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.071818 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.071959 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.072147 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.072439 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.072619 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.072760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.072898 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.073068 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.073341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.073484 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.073676 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.073834 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.074000 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.074383 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.074616 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.074616 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.075045 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.075308 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.075508 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.075655 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.075655 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.075901 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.076038 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.076404 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.076565 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.076712 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.076937 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.077088 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.077344 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.077483 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.077613 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.077749 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.077887 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.078139 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.078275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.078583 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.078821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.079133 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.079476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.079728 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.079860 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.080081 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.080243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.080391 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.080512 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.080699 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.080820 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.081005 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.081132 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.081340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.081475 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 15:04:44.081801 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.081998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.082327 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.082644 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.082971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.083354 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.083642 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.084589 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.084589 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.084589 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.085311 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.085311 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.085815 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.085961 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.086144 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.086461 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.086773 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.087106 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.087463 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.088760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.088760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.089064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.089229 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.089543 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.089862 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.090197 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.090536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.090827 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.091152 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.091495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.091812 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.092132 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.092454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.092787 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.093117 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.093433 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.093763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.094094 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.094449 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.094774 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.095176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.095473 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.095782 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.096097 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.096463 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 15:04:44.096668 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 15:04:44.143042 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO dbcounter [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] Registered counter for database nova_api May 19 15:04:44.156545 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO dbcounter [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] Registered counter for database nova_api May 19 15:04:44.164279 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_db.sqlalchemy.engines [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 15:04:44.172362 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writer thread running {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 15:04:44.178381 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_db.sqlalchemy.engines [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 15:04:44.185689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writer thread running {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 15:04:44.229286 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.context [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29378f11-e05f-41fc-b3d7-85c26456dbc0(cell1) {{(pid=117444) load_cells /opt/stack/nova/nova/context.py:464}} May 19 15:04:44.233710 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:04:44.235439 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:04:44.236242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:04:44.238225 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:04:44.240319 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO dbcounter [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] Registered counter for database nova_cell0 May 19 15:04:44.241545 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.context [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29378f11-e05f-41fc-b3d7-85c26456dbc0(cell1) {{(pid=117445) load_cells /opt/stack/nova/nova/context.py:464}} May 19 15:04:44.244859 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO dbcounter [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] Registered counter for database nova_cell1 May 19 15:04:44.245970 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:04:44.247855 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:04:44.248642 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:04:44.250620 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:04:44.252466 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_db.sqlalchemy.engines [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 15:04:44.252682 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO dbcounter [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] Registered counter for database nova_cell0 May 19 15:04:44.254320 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_db.sqlalchemy.engines [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 15:04:44.256760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO dbcounter [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] Registered counter for database nova_cell1 May 19 15:04:44.259984 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writer thread running {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 15:04:44.262222 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writer thread running {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 15:04:44.263559 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_db.sqlalchemy.engines [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 15:04:44.265709 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_db.sqlalchemy.engines [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 15:04:44.270285 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writer thread running {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 15:04:44.410053 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writer thread running {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 15:04:44.414124 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO dbcounter [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] Registered counter for database nova_cell0 May 19 15:04:44.420516 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO dbcounter [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] Registered counter for database nova_cell0 May 19 15:04:44.421463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_db.sqlalchemy.engines [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 15:04:44.425862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writer thread running {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 15:04:44.428694 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_db.sqlalchemy.engines [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 15:04:44.434058 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writer thread running {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 15:04:44.754133 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: WARNING keystonemiddleware.auth_token [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 15:04:44.762257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: WARNING keystonemiddleware.auth_token [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 15:04:44.763354 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: WARNING keystonemiddleware.auth_token [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 15:04:44.771142 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: WARNING keystonemiddleware.auth_token [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 15:04:45.125849 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: WARNING keystonemiddleware.auth_token [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 15:04:45.126267 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: WARNING keystonemiddleware.auth_token [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 15:04:45.132067 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: WARNING keystonemiddleware.auth_token [None req-9c39d2a5-ca0c-4110-a540-1418b2c87315 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 15:04:45.132632 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: WARNING keystonemiddleware.auth_token [None req-1f275745-2418-425f-a8b7-9b7d29bc8865 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 15:04:45.137952 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0c3cd89c0 pid: 117444 (default app) May 19 15:04:45.138563 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0c3cd89c0 pid: 117445 (default app) May 19 15:05:26.325793 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:26.326624 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:26.328055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:26.328956 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:27.213616 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=3 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:27.214557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=3 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:27.215727 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=3 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:27.219938 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=3 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:27.563233 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c3765b8c-990b-4983-804f-817e3c227894 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Action: 'create', calling method: .version_select at 0x7f35d33ca4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-775448148", "metadata": {"Type": "work"}}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c3765b8c-990b-4983-804f-817e3c227894 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Request method failure captured: May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 121 May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihly2ukwASqhDEUovjdHFEdVxPlKMGwABZq_d0gvcioIeQA_lRVTM1kfQaBVLgq5ks_HiJ_zEoKzg4hX8SWn44CCTivAcB-WOYnE1FzzwsoYYnv_Ob68_vKYyF3vMItyXNjAy3Gy8NMvcKNjO78XhMquFJTQQxMoS9CPeng7MvJvZx9M May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 9df0c05a04984193ad8649a31bcb7d05 May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-VolumesNegativeTest-402783282 May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:05:27.595243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:05:27.596659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_9df0c05a04984193ad8649a31bcb7d05", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:05:27.596659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-VolumesNegativeTest-402783282 May 19 15:05:27.596659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 9df0c05a04984193ad8649a31bcb7d05 May 19 15:05:27.596659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-VolumesNegativeTest-402783282 May 19 15:05:27.596659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-VolumesNegativeTest-402783282-project May 19 15:05:27.596659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:05:27.596659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:05:27.596659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: 1433960e92d44d23b690e40a733778a8 May 19 15:05:27.596659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-VolumesNegativeTest-402783282-project May 19 15:05:27.596659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: May 19 15:05:27.596659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-775448148", "metadata": {"Type": "work"}}} May 19 15:05:27.596659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: May 19 15:05:27.596659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-775448148', 'metadata': {'Type': 'work'}}}} May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise error May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi '#$%' May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:05:27.597510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 15:05:27.598870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 15:05:27.600124 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 15:05:27.600124 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.600124 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c3765b8c-990b-4983-804f-817e3c227894 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:05:27.600124 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c3765b8c-990b-4983-804f-817e3c227894 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.276478 May 19 15:05:27.600124 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 1/1] 10.222.0.24 () {60 vars in 1155 bytes} [Thu May 19 15:05:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1278 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 15:05:27.606457 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-448ce9eb-2af9-46b8-850b-c4454a5c9d85 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Action: 'create', calling method: .version_select at 0x7f35d330a820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-951736333", "metadata": {"Type": "work"}}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-448ce9eb-2af9-46b8-850b-c4454a5c9d85 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Request method failure captured: May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 119 May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihly2ukwASqhDEUovjdHFEdVxPlKMGwABZq_d0gvcioIeQA_lRVTM1kfQaBVLgq5ks_HiJ_zEoKzg4hX8SWn44CCTivAcB-WOYnE1FzzwsoYYnv_Ob68_vKYyF3vMItyXNjAy3Gy8NMvcKNjO78XhMquFJTQQxMoS9CPeng7MvJvZx9M May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 9df0c05a04984193ad8649a31bcb7d05 May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-VolumesNegativeTest-402783282 May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:05:27.609401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:05:27.610670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_9df0c05a04984193ad8649a31bcb7d05", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:05:27.610670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-VolumesNegativeTest-402783282 May 19 15:05:27.610670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 9df0c05a04984193ad8649a31bcb7d05 May 19 15:05:27.610670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-VolumesNegativeTest-402783282 May 19 15:05:27.610670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-VolumesNegativeTest-402783282-project May 19 15:05:27.610670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:05:27.610670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:05:27.610670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: 1433960e92d44d23b690e40a733778a8 May 19 15:05:27.610670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-VolumesNegativeTest-402783282-project May 19 15:05:27.610670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: May 19 15:05:27.610670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-951736333", "metadata": {"Type": "work"}}} May 19 15:05:27.610670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: May 19 15:05:27.610670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-951736333', 'metadata': {'Type': 'work'}}}} May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise error May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi '0' May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:05:27.611510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 15:05:27.612825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 15:05:27.613887 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 15:05:27.613887 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.613887 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-448ce9eb-2af9-46b8-850b-c4454a5c9d85 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:05:27.618947 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-448ce9eb-2af9-46b8-850b-c4454a5c9d85 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016246 May 19 15:05:27.619965 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 2/2] 10.222.0.24 () {60 vars in 1155 bytes} [Thu May 19 15:05:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 15:05:27.629376 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a6ebadfb-24d5-4081-a666-a30c137383be tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Action: 'create', calling method: .version_select at 0x7f35d33ca820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-956960456", "metadata": {"Type": "work"}}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a6ebadfb-24d5-4081-a666-a30c137383be tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Request method failure captured: May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 118 May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihly2ukwASqhDEUovjdHFEdVxPlKMGwABZq_d0gvcioIeQA_lRVTM1kfQaBVLgq5ks_HiJ_zEoKzg4hX8SWn44CCTivAcB-WOYnE1FzzwsoYYnv_Ob68_vKYyF3vMItyXNjAy3Gy8NMvcKNjO78XhMquFJTQQxMoS9CPeng7MvJvZx9M May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 9df0c05a04984193ad8649a31bcb7d05 May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-VolumesNegativeTest-402783282 May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:05:27.634631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:05:27.636893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_9df0c05a04984193ad8649a31bcb7d05", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:05:27.636893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-VolumesNegativeTest-402783282 May 19 15:05:27.636893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 9df0c05a04984193ad8649a31bcb7d05 May 19 15:05:27.636893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-VolumesNegativeTest-402783282 May 19 15:05:27.636893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-VolumesNegativeTest-402783282-project May 19 15:05:27.636893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:05:27.636893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:05:27.636893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: 1433960e92d44d23b690e40a733778a8 May 19 15:05:27.636893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-VolumesNegativeTest-402783282-project May 19 15:05:27.636893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: May 19 15:05:27.636893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-956960456", "metadata": {"Type": "work"}}} May 19 15:05:27.636893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: May 19 15:05:27.636893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-956960456', 'metadata': {'Type': 'work'}}}} May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise error May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi '' May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:05:27.637743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 15:05:27.639066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 15:05:27.640721 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 15:05:27.640721 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:27.640721 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a6ebadfb-24d5-4081-a666-a30c137383be tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:05:27.640721 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a6ebadfb-24d5-4081-a666-a30c137383be tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010958 May 19 15:05:27.640721 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 3/3] 10.222.0.24 () {60 vars in 1155 bytes} [Thu May 19 15:05:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 15:05:27.650300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c14efb2b-56db-4a60-928c-c5b761a1a696 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Calling method '.version_select at 0x7f35d3277550>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:28.422185 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-15da187e-60a1-46d7-8814-f51872b67361 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Action: 'create', calling method: .version_select at 0x7f35d33c8550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2096770148"}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:05:28.895117 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-c14efb2b-56db-4a60-928c-c5b761a1a696 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] HTTP exception thrown: Volume tempest-invalid-1261327552 could not be found. May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c14efb2b-56db-4a60-928c-c5b761a1a696 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Request method failure captured: May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1261327552 HTTP/1.1 May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihly2ukwASqhDEUovjdHFEdVxPlKMGwABZq_d0gvcioIeQA_lRVTM1kfQaBVLgq5ks_HiJ_zEoKzg4hX8SWn44CCTivAcB-WOYnE1FzzwsoYYnv_Ob68_vKYyF3vMItyXNjAy3Gy8NMvcKNjO78XhMquFJTQQxMoS9CPeng7MvJvZx9M May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 9df0c05a04984193ad8649a31bcb7d05 May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-VolumesNegativeTest-402783282 May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:05:28.900104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:05:28.901534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_9df0c05a04984193ad8649a31bcb7d05", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:05:28.901534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-VolumesNegativeTest-402783282 May 19 15:05:28.901534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 9df0c05a04984193ad8649a31bcb7d05 May 19 15:05:28.901534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-VolumesNegativeTest-402783282 May 19 15:05:28.901534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-VolumesNegativeTest-402783282-project May 19 15:05:28.901534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:05:28.901534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:05:28.901534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: 1433960e92d44d23b690e40a733778a8 May 19 15:05:28.901534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-VolumesNegativeTest-402783282-project May 19 15:05:28.901534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: May 19 15:05:28.901534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Volume tempest-invalid-1261327552 could not be found. May 19 15:05:28.901534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': 'tempest-invalid-1261327552'} May 19 15:05:28.901534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1261327552 could not be found. (HTTP 404) (Request-ID: req-a3a98d78-0a49-4b05-8dfb-63548a088294) May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:28.902307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 15:05:28.903458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1261327552 could not be found. May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:05:28.904634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1261327552 could not be found. May 19 15:05:28.905732 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:28.905732 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:28.905732 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:28.905732 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:28.905732 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:28.905732 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:28.905732 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:05:28.905732 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:05:28.905732 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1261327552 could not be found. May 19 15:05:28.905732 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:28.905732 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c14efb2b-56db-4a60-928c-c5b761a1a696 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Returning 404 to user: Volume tempest-invalid-1261327552 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:05:28.905732 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c14efb2b-56db-4a60-928c-c5b761a1a696 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1261327552" status: 404 len: 99 microversion: 2.1 time: 1.259703 May 19 15:05:28.905732 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 4/4] 10.222.0.24 () {58 vars in 1217 bytes} [Thu May 19 15:05:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1261327552 => generated 99 bytes in 1261 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 15:05:29.072512 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-938456741", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "networks": [{"uuid": "1b8ce7f1-e5c0-4589-9b93-f3357d7e9572"}]}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:05:29.296925 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] validate_networks() for [('1b8ce7f1-e5c0-4589-9b93-f3357d7e9572', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:05:30.430943 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-15da187e-60a1-46d7-8814-f51872b67361 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.230517 May 19 15:05:30.439336 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 1/5] 10.222.0.24 () {60 vars in 1154 bytes} [Thu May 19 15:05:27 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3240 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 19 15:05:30.446771 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-d1edce33-6a7b-488c-9ae4-915751862a66 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005955 May 19 15:05:30.453670 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 2/6] 10.222.0.24 () {58 vars in 1139 bytes} [Thu May 19 15:05:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 15:05:30.467053 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-1155757f-2e1d-4d18-ab27-2200b1334fa4 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d3294790>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:30.648758 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-1155757f-2e1d-4d18-ab27-2200b1334fa4 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d" status: 200 len: 345 microversion: 2.1 time: 0.193102 May 19 15:05:30.650072 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 3/7] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 15:05:30 2022] GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d => generated 345 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:30.659605 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9a49d78e-f644-494d-b4ba-88c1f3b565cc tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008115 May 19 15:05:30.661228 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 4/8] 10.222.0.24 () {58 vars in 1136 bytes} [Thu May 19 15:05:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 15:05:30.672878 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e0afc398-4f58-4760-83ef-5a95cf4a3f7d tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Calling method '.version_select at 0x7f35d3294670>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:30.718263 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-e0afc398-4f58-4760-83ef-5a95cf4a3f7d tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] HTTP exception thrown: Volume bccbf172-b522-4cc4-8e78-e0b8f5eb8231 could not be found. May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e0afc398-4f58-4760-83ef-5a95cf4a3f7d tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Request method failure captured: May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: DELETE /compute/v2.1/os-volumes/bccbf172-b522-4cc4-8e78-e0b8f5eb8231 HTTP/1.1 May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihly2ukwASqhDEUovjdHFEdVxPlKMGwABZq_d0gvcioIeQA_lRVTM1kfQaBVLgq5ks_HiJ_zEoKzg4hX8SWn44CCTivAcB-WOYnE1FzzwsoYYnv_Ob68_vKYyF3vMItyXNjAy3Gy8NMvcKNjO78XhMquFJTQQxMoS9CPeng7MvJvZx9M May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 9df0c05a04984193ad8649a31bcb7d05 May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-VolumesNegativeTest-402783282 May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:05:30.722974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:05:30.724296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_9df0c05a04984193ad8649a31bcb7d05", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:05:30.724296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-VolumesNegativeTest-402783282 May 19 15:05:30.724296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 9df0c05a04984193ad8649a31bcb7d05 May 19 15:05:30.724296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-VolumesNegativeTest-402783282 May 19 15:05:30.724296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-VolumesNegativeTest-402783282-project May 19 15:05:30.724296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:05:30.724296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:05:30.724296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 1433960e92d44d23b690e40a733778a8 May 19 15:05:30.724296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-VolumesNegativeTest-402783282-project May 19 15:05:30.724296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: May 19 15:05:30.724296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Volume bccbf172-b522-4cc4-8e78-e0b8f5eb8231 could not be found. May 19 15:05:30.724296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': 'bccbf172-b522-4cc4-8e78-e0b8f5eb8231'} May 19 15:05:30.724296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bccbf172-b522-4cc4-8e78-e0b8f5eb8231 could not be found. (HTTP 404) (Request-ID: req-5f0a9634-ce52-406f-813f-70064835897f) May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:30.725210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 15:05:30.726295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bccbf172-b522-4cc4-8e78-e0b8f5eb8231 could not be found. May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 15:05:30.727521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:05:30.728640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bccbf172-b522-4cc4-8e78-e0b8f5eb8231 could not be found. May 19 15:05:30.728640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:30.728640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:30.728640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:30.728640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:30.728640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:30.728640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:30.728640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:05:30.728640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:05:30.728640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bccbf172-b522-4cc4-8e78-e0b8f5eb8231 could not be found. May 19 15:05:30.728640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:30.731802 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e0afc398-4f58-4760-83ef-5a95cf4a3f7d tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Returning 404 to user: Volume bccbf172-b522-4cc4-8e78-e0b8f5eb8231 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:05:30.733096 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e0afc398-4f58-4760-83ef-5a95cf4a3f7d tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/bccbf172-b522-4cc4-8e78-e0b8f5eb8231" status: 404 len: 109 microversion: 2.1 time: 0.066952 May 19 15:05:30.734096 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 5/9] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 15:05:30 2022] DELETE /compute/v2.1/os-volumes/bccbf172-b522-4cc4-8e78-e0b8f5eb8231 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 15:05:30.759400 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-310da104-2d49-4ac0-8de0-b9b021499997 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Calling method '.version_select at 0x7f35d3c769d0>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:30.826361 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-310da104-2d49-4ac0-8de0-b9b021499997 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] HTTP exception thrown: Volume 6c8c53a8-fc4d-43f0-b680-57c4494b2cd4 could not be found. May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-310da104-2d49-4ac0-8de0-b9b021499997 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Request method failure captured: May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/os-volumes/6c8c53a8-fc4d-43f0-b680-57c4494b2cd4 HTTP/1.1 May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihly2ukwASqhDEUovjdHFEdVxPlKMGwABZq_d0gvcioIeQA_lRVTM1kfQaBVLgq5ks_HiJ_zEoKzg4hX8SWn44CCTivAcB-WOYnE1FzzwsoYYnv_Ob68_vKYyF3vMItyXNjAy3Gy8NMvcKNjO78XhMquFJTQQxMoS9CPeng7MvJvZx9M May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 9df0c05a04984193ad8649a31bcb7d05 May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-VolumesNegativeTest-402783282 May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:05:30.830146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:05:30.831538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_9df0c05a04984193ad8649a31bcb7d05", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/9df0c05a04984193ad8649a31bcb7d05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:05:30.831538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-VolumesNegativeTest-402783282 May 19 15:05:30.831538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 9df0c05a04984193ad8649a31bcb7d05 May 19 15:05:30.831538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-VolumesNegativeTest-402783282 May 19 15:05:30.831538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-VolumesNegativeTest-402783282-project May 19 15:05:30.831538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:05:30.831538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:05:30.831538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 1433960e92d44d23b690e40a733778a8 May 19 15:05:30.831538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-VolumesNegativeTest-402783282-project May 19 15:05:30.831538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: May 19 15:05:30.831538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Volume 6c8c53a8-fc4d-43f0-b680-57c4494b2cd4 could not be found. May 19 15:05:30.831538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '6c8c53a8-fc4d-43f0-b680-57c4494b2cd4'} May 19 15:05:30.831538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c8c53a8-fc4d-43f0-b680-57c4494b2cd4 could not be found. (HTTP 404) (Request-ID: req-e541ca2c-c3a5-4439-b3a0-ca0dbf0230e8) May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:30.832413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 15:05:30.833515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c8c53a8-fc4d-43f0-b680-57c4494b2cd4 could not be found. May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 15:05:30.834586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:05:30.839043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c8c53a8-fc4d-43f0-b680-57c4494b2cd4 could not be found. May 19 15:05:30.839043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:30.839043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:30.839043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:30.839043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:30.839043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:30.839043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:30.839043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:05:30.839043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:05:30.839043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c8c53a8-fc4d-43f0-b680-57c4494b2cd4 could not be found. May 19 15:05:30.839043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:30.849446 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-310da104-2d49-4ac0-8de0-b9b021499997 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] Returning 404 to user: Volume 6c8c53a8-fc4d-43f0-b680-57c4494b2cd4 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:05:30.851038 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-310da104-2d49-4ac0-8de0-b9b021499997 tempest-VolumesNegativeTest-402783282 tempest-VolumesNegativeTest-402783282-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/6c8c53a8-fc4d-43f0-b680-57c4494b2cd4" status: 404 len: 109 microversion: 2.1 time: 0.103084 May 19 15:05:30.852710 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 6/10] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 15:05:30 2022] GET /compute/v2.1/os-volumes/6c8c53a8-fc4d-43f0-b680-57c4494b2cd4 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:05:31.126887 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:05:31.127500 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:05:31.128208 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:05:31.128648 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:05:31.129073 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:05:31.165956 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:31.166988 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:31.168638 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:31.169314 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:31.214559 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Getting quotas for project 4f393107cd16496f85de03046f03c461. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:05:31.224175 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Getting quotas for user 8b06fc42235a4ea08cd81b2bf6b4a4cb and project 4f393107cd16496f85de03046f03c461. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:05:31.246963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:05:31.259044 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:05:31.365281 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fb5f4e7c-509c-4c5b-ad5c-a7ecfb4ab87e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.460317 May 19 15:05:31.376977 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-11179613-efd4-45b9-b6b1-1fe5cba6e96a tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:31.378085 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-11179613-efd4-45b9-b6b1-1fe5cba6e96a tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:31.378493 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 5/11] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:05:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:05:31.663645 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4af0f323-c9c9-4122-9b86-3d355070ebec tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d3132550>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:31.702779 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-11179613-efd4-45b9-b6b1-1fe5cba6e96a tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:31.779329 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-11179613-efd4-45b9-b6b1-1fe5cba6e96a tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1214 microversion: 2.1 time: 0.403706 May 19 15:05:31.785766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 7/12] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:31 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1214 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:31.906177 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4af0f323-c9c9-4122-9b86-3d355070ebec tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d" status: 200 len: 346 microversion: 2.1 time: 0.247686 May 19 15:05:31.906869 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 6/13] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 15:05:31 2022] GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d => generated 346 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:05:31.921797 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6856f77e-b747-4688-872a-df76c92dfcf1 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Action: 'create', calling method: .version_select at 0x7f35d3211790>, body: {"snapshot": {"volume_id": "40f66bf0-b27a-41d2-abce-6900b239f07d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1324462689"}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:05:32.495241 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6856f77e-b747-4688-872a-df76c92dfcf1 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.579599 May 19 15:05:32.496703 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 8/14] 10.222.0.24 () {60 vars in 1161 bytes} [Thu May 19 15:05:31 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:32.508021 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7fdf1272-fb1e-4ea2-813f-f8f624334299 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d3132ca0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:32.800274 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ed7ba6d8-b64c-4e49-9669-a849407eee93 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:32.800894 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ed7ba6d8-b64c-4e49-9669-a849407eee93 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:32.820430 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7fdf1272-fb1e-4ea2-813f-f8f624334299 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5" status: 200 len: 287 microversion: 2.1 time: 0.317519 May 19 15:05:32.820995 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 7/15] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 15:05:32 2022] GET /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5 => generated 287 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:32.830740 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d01bdbc1-7e8e-42b5-8ded-abff934ae9dd tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d3132ee0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:33.007181 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d01bdbc1-7e8e-42b5-8ded-abff934ae9dd tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.180290 May 19 15:05:33.008112 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 8/16] 10.222.0.24 () {58 vars in 1139 bytes} [Thu May 19 15:05:32 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:33.019156 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-79c4de89-e75c-48bb-99fe-bd52675858c2 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d20c1040>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:33.050571 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ed7ba6d8-b64c-4e49-9669-a849407eee93 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:33.068815 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ed7ba6d8-b64c-4e49-9669-a849407eee93 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1214 microversion: 2.1 time: 0.267513 May 19 15:05:33.074269 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 9/17] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:32 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1214 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:33.085700 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-79c4de89-e75c-48bb-99fe-bd52675858c2 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5" status: 200 len: 287 microversion: 2.1 time: 0.071444 May 19 15:05:33.088734 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 9/18] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 15:05:33 2022] GET /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:05:34.088272 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4acd47db-49ad-40f3-967a-303617e686cc tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:34.088827 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4acd47db-49ad-40f3-967a-303617e686cc tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:34.099821 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-69e2f771-3958-4d33-997b-19ffb4f87903 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d20c1700>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:34.159074 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-69e2f771-3958-4d33-997b-19ffb4f87903 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5" status: 200 len: 287 microversion: 2.1 time: 0.058718 May 19 15:05:34.159074 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 10/19] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 15:05:34 2022] GET /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:34.298287 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4acd47db-49ad-40f3-967a-303617e686cc tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:34.330669 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4acd47db-49ad-40f3-967a-303617e686cc tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1214 microversion: 2.1 time: 0.239165 May 19 15:05:34.334606 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 10/20] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:34 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1214 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:35.171579 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8847ddef-77be-4352-a185-4bc700ece2df tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d31320d0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:35.232318 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8847ddef-77be-4352-a185-4bc700ece2df tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5" status: 200 len: 287 microversion: 2.1 time: 0.065621 May 19 15:05:35.232895 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 11/21] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 15:05:35 2022] GET /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:35.353662 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-765df2f0-acc0-4d35-8b76-7788dac341ea tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:35.355083 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-765df2f0-acc0-4d35-8b76-7788dac341ea tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:35.371532 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-765df2f0-acc0-4d35-8b76-7788dac341ea tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:35.371532 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-765df2f0-acc0-4d35-8b76-7788dac341ea tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:35.371532 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-765df2f0-acc0-4d35-8b76-7788dac341ea tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:35.373514 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-765df2f0-acc0-4d35-8b76-7788dac341ea tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:35.734342 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-765df2f0-acc0-4d35-8b76-7788dac341ea tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:35.771786 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-765df2f0-acc0-4d35-8b76-7788dac341ea tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1218 microversion: 2.1 time: 0.424781 May 19 15:05:35.774510 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 11/22] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:35 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1218 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:05:36.244460 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-047c0ef8-8ce3-4c39-b11c-409cf6355e33 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d31328b0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:36.371315 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-047c0ef8-8ce3-4c39-b11c-409cf6355e33 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5" status: 200 len: 288 microversion: 2.1 time: 0.129468 May 19 15:05:36.378061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 12/23] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 15:05:36 2022] GET /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5 => generated 288 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:36.382491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9963c620-c298-49bf-802c-8ad6c65a1339 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d314bc10>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:36.601526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9963c620-c298-49bf-802c-8ad6c65a1339 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "DELETE /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5" status: 202 len: 0 microversion: 2.1 time: 0.220288 May 19 15:05:36.603010 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 12/24] 10.222.0.24 () {58 vars in 1253 bytes} [Thu May 19 15:05:36 2022] DELETE /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 15:05:36.611562 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-acac99d5-da4c-47e8-8488-91816036e2bc tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d20c19d0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:36.695923 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-acac99d5-da4c-47e8-8488-91816036e2bc tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5" status: 200 len: 287 microversion: 2.1 time: 0.088135 May 19 15:05:36.701080 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 13/25] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 15:05:36 2022] GET /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5 => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:36.792070 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-0dbaad50-6f56-4047-9409-4762d88fdf5a tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:36.794985 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-0dbaad50-6f56-4047-9409-4762d88fdf5a tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:36.828874 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0dbaad50-6f56-4047-9409-4762d88fdf5a tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:36.829850 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0dbaad50-6f56-4047-9409-4762d88fdf5a tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:36.830854 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0dbaad50-6f56-4047-9409-4762d88fdf5a tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:36.831649 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0dbaad50-6f56-4047-9409-4762d88fdf5a tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:37.442388 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-0dbaad50-6f56-4047-9409-4762d88fdf5a tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:37.471785 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-0dbaad50-6f56-4047-9409-4762d88fdf5a tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1284 microversion: 2.1 time: 0.684309 May 19 15:05:37.473163 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 13/26] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:36 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1284 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:05:37.708642 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4929baa6-b64c-4d7c-b464-9c200bb70350 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d20c1160>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:37.748052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-4929baa6-b64c-4d7c-b464-9c200bb70350 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] HTTP exception thrown: Snapshot 96a1ba1b-9722-40f3-b96d-b855036ecda5 could not be found. May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4929baa6-b64c-4d7c-b464-9c200bb70350 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Request method failure captured: May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5 HTTP/1.1 May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihly3cqqN_aLWZxlHlFBg-m23hc3fb5yTlL37V9MpO3Nh0aVpsxKwDXlBWxqFbdGsuPg05wgBfACO2_ULhJP-RmsB1W5xzCBloPiIkEXgE6QZM_gcanvaBwM5qR3Oeo2TDmjGEHsOUR1sbEIVJVfqlPJwjDuVomdU6I6A4SEUwQkZgNo May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 33f091f18edf4402bd1e81f64f97a7a0 May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-931261045 May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:05:37.750408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:05:37.751525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_33f091f18edf4402bd1e81f64f97a7a0", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/33f091f18edf4402bd1e81f64f97a7a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/33f091f18edf4402bd1e81f64f97a7a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/33f091f18edf4402bd1e81f64f97a7a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:05:37.751525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-VolumesSnapshotsTestJSON-931261045 May 19 15:05:37.751525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 33f091f18edf4402bd1e81f64f97a7a0 May 19 15:05:37.751525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-931261045 May 19 15:05:37.751525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-VolumesSnapshotsTestJSON-931261045-project May 19 15:05:37.751525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:05:37.751525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:05:37.751525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: 0eb25b3219a84d76ac31193db03fd2b3 May 19 15:05:37.751525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-VolumesSnapshotsTestJSON-931261045-project May 19 15:05:37.751525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: May 19 15:05:37.751525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Snapshot 96a1ba1b-9722-40f3-b96d-b855036ecda5 could not be found. May 19 15:05:37.751525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': '96a1ba1b-9722-40f3-b96d-b855036ecda5'} May 19 15:05:37.751525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 96a1ba1b-9722-40f3-b96d-b855036ecda5 could not be found. (HTTP 404) (Request-ID: req-f9c3d37b-4387-4cca-b41a-720d5ef437f6) May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:37.752242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 15:05:37.753066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 96a1ba1b-9722-40f3-b96d-b855036ecda5 could not be found. May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 19 15:05:37.753929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:05:37.754843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 96a1ba1b-9722-40f3-b96d-b855036ecda5 could not be found. May 19 15:05:37.754843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:37.754843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:37.754843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:37.754843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:37.754843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:37.754843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:37.754843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:05:37.754843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:05:37.754843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 96a1ba1b-9722-40f3-b96d-b855036ecda5 could not be found. May 19 15:05:37.754843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:37.754843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4929baa6-b64c-4d7c-b464-9c200bb70350 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Returning 404 to user: Snapshot 96a1ba1b-9722-40f3-b96d-b855036ecda5 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:05:37.754843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4929baa6-b64c-4d7c-b464-9c200bb70350 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5" status: 404 len: 111 microversion: 2.1 time: 0.047084 May 19 15:05:37.754843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 14/27] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 15:05:37 2022] GET /compute/v2.1/os-snapshots/96a1ba1b-9722-40f3-b96d-b855036ecda5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:05:37.765107 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-fe972bad-90d1-4f8a-b4da-53e014c52917 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d3170160>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:37.930355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-fe972bad-90d1-4f8a-b4da-53e014c52917 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d" status: 202 len: 0 microversion: 2.1 time: 0.169378 May 19 15:05:37.939705 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b403291e-5ef0-4a4d-b003-c1459a64e520 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d31324c0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:37.943708 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 14/28] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 15:05:37 2022] DELETE /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:05:38.073028 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b403291e-5ef0-4a4d-b003-c1459a64e520 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d" status: 200 len: 345 microversion: 2.1 time: 0.137326 May 19 15:05:38.078276 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 15/29] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 15:05:37 2022] GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d => generated 345 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:38.490768 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-71c348a9-4b2c-4e19-a0eb-def07cc26fe8 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:38.491518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-71c348a9-4b2c-4e19-a0eb-def07cc26fe8 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:38.510514 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-71c348a9-4b2c-4e19-a0eb-def07cc26fe8 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:38.511677 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-71c348a9-4b2c-4e19-a0eb-def07cc26fe8 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:38.514418 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-71c348a9-4b2c-4e19-a0eb-def07cc26fe8 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:38.514872 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-71c348a9-4b2c-4e19-a0eb-def07cc26fe8 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:38.777917 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-71c348a9-4b2c-4e19-a0eb-def07cc26fe8 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:38.790468 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-71c348a9-4b2c-4e19-a0eb-def07cc26fe8 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1272 microversion: 2.1 time: 0.303520 May 19 15:05:38.792284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 15/30] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:38 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1272 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:39.086388 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d31a155f-c77d-4e7e-9bed-aa5e9894e76b tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d3211160>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:39.262528 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-d31a155f-c77d-4e7e-9bed-aa5e9894e76b tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d" status: 200 len: 345 microversion: 2.1 time: 0.180577 May 19 15:05:39.267543 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 16/31] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 15:05:39 2022] GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d => generated 345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:39.401256 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f4f15b24-e815-4817-a06c-7514df9522d6 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Action: 'create', calling method: .version_select at 0x7f35d20c11f0>, body: {"keypair": {"name": "tempest-keypair-1850093322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGI1zao5QrC+waq1glyzHf/v3w8Cw0X/R5yKGSBIU97k+LmUSpJ8RBkobn1+ah9xIzx3DJOrGfdT94DVPL7Sk3H2J78oLlHHD+uDVxM+DNhnT/uOPqvtAb6AWcF4YCdSpQ=="}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:05:39.485172 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-f4f15b24-e815-4817-a06c-7514df9522d6 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for project 34c1099557144b8bb2fff88f5b526834. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:05:39.490303 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-f4f15b24-e815-4817-a06c-7514df9522d6 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for user af7838e525a042dfa0357ad1fc58cf21 and project 34c1099557144b8bb2fff88f5b526834. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:05:39.575850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f4f15b24-e815-4817-a06c-7514df9522d6 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.746939 May 19 15:05:39.582832 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 16/32] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 15:05:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:39.812760 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-29375eb8-f124-453e-9fba-bf9ff360407e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:39.813778 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-29375eb8-f124-453e-9fba-bf9ff360407e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:39.845677 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-29375eb8-f124-453e-9fba-bf9ff360407e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:39.846145 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-29375eb8-f124-453e-9fba-bf9ff360407e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:39.846962 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-29375eb8-f124-453e-9fba-bf9ff360407e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:39.847443 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-29375eb8-f124-453e-9fba-bf9ff360407e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:40.118303 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1219219155", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:05:40.423894 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.network.neutron [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] validate_networks() for [('fba0d92a-cc3d-4407-a8fd-52349f4553f3', None, None, None, None, None)] {{(pid=117445) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:05:40.486314 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-29375eb8-f124-453e-9fba-bf9ff360407e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:40.551109 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-29375eb8-f124-453e-9fba-bf9ff360407e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1272 microversion: 2.1 time: 0.746898 May 19 15:05:40.558328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 17/33] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:39 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1272 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:40.584333 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-70ae903d-13f9-4c76-8120-2ffd334b1faa tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d18195e0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:40.734196 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-70ae903d-13f9-4c76-8120-2ffd334b1faa tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d" status: 200 len: 345 microversion: 2.1 time: 0.174545 May 19 15:05:40.734975 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 18/34] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 15:05:40 2022] GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d => generated 345 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:41.574929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:41.579313 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ea5b284e-e2b0-40ae-815a-ab65c7970c6e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:41.580006 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ea5b284e-e2b0-40ae-815a-ab65c7970c6e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:41.609243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ea5b284e-e2b0-40ae-815a-ab65c7970c6e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:41.609854 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ea5b284e-e2b0-40ae-815a-ab65c7970c6e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:41.610640 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ea5b284e-e2b0-40ae-815a-ab65c7970c6e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:41.611169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ea5b284e-e2b0-40ae-815a-ab65c7970c6e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:41.938154 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ea5b284e-e2b0-40ae-815a-ab65c7970c6e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:41.945890 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ea5b284e-e2b0-40ae-815a-ab65c7970c6e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1272 microversion: 2.1 time: 0.371792 May 19 15:05:41.946487 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 19/35] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:41 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1272 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:05:41.959539 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9ccfb4d1-ba17-45bf-bfd3-b09e57a7d87d tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d17ba550>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:42.100462 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Flavor limits 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:05:42.101039 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Image limits 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:05:42.101927 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Flavor pref 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:05:42.102353 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Image pref 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:05:42.108557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:05:42.109280 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9ccfb4d1-ba17-45bf-bfd3-b09e57a7d87d tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d" status: 200 len: 345 microversion: 2.1 time: 0.161729 May 19 15:05:42.110214 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 20/36] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 15:05:41 2022] GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d => generated 345 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:42.149510 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:42.149967 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:42.152540 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:42.154854 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:42.233874 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Getting quotas for project 199f08479d9541bc936bb4ea80bae96a. Resources: {'cores', 'instances', 'ram'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:05:42.247045 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Getting quotas for user e5374c90f38b47fcb611e346f3f2ec69 and project 199f08479d9541bc936bb4ea80bae96a. Resources: {'cores', 'instances', 'ram'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:05:42.274683 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Going to run 1 instances... {{(pid=117445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:05:42.280616 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:05:42.450560 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-20b8a632-cf7e-4a7b-848e-a5ef3553cffd tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.761898 May 19 15:05:42.450746 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 17/37] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:05:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 2763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:05:42.469149 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0eeba664-88ee-4430-a48d-43e24ea6df93 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:42.469777 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0eeba664-88ee-4430-a48d-43e24ea6df93 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:42.798478 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0eeba664-88ee-4430-a48d-43e24ea6df93 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:42.819233 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0eeba664-88ee-4430-a48d-43e24ea6df93 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1222 microversion: 2.1 time: 0.359565 May 19 15:05:42.823700 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 21/38] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:42 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1222 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:42.965369 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-93ad5cc8-4231-40ca-83a1-55fd9a3b2a39 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:42.966858 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-93ad5cc8-4231-40ca-83a1-55fd9a3b2a39 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:42.995760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-93ad5cc8-4231-40ca-83a1-55fd9a3b2a39 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:42.999437 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-93ad5cc8-4231-40ca-83a1-55fd9a3b2a39 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:43.006894 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-93ad5cc8-4231-40ca-83a1-55fd9a3b2a39 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:43.009979 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-93ad5cc8-4231-40ca-83a1-55fd9a3b2a39 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:43.042931 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1661821675", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:05:43.213436 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] validate_networks() for [('fba0d92a-cc3d-4407-a8fd-52349f4553f3', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:05:43.825922 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-93ad5cc8-4231-40ca-83a1-55fd9a3b2a39 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:43.839504 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-93ad5cc8-4231-40ca-83a1-55fd9a3b2a39 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1272 microversion: 2.1 time: 0.880056 May 19 15:05:43.846494 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 18/39] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:42 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1272 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:43.861198 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-148d5d4a-cce8-4291-8a5e-efdadce9fdbe tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d280f3a0>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:43.962387 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-148d5d4a-cce8-4291-8a5e-efdadce9fdbe tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] HTTP exception thrown: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-148d5d4a-cce8-4291-8a5e-efdadce9fdbe tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Request method failure captured: May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d HTTP/1.1 May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihly3cqqN_aLWZxlHlFBg-m23hc3fb5yTlL37V9MpO3Nh0aVpsxKwDXlBWxqFbdGsuPg05wgBfACO2_ULhJP-RmsB1W5xzCBloPiIkEXgE6QZM_gcanvaBwM5qR3Oeo2TDmjGEHsOUR1sbEIVJVfqlPJwjDuVomdU6I6A4SEUwQkZgNo May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 33f091f18edf4402bd1e81f64f97a7a0 May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-931261045 May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:05:43.964717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:05:43.966454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_33f091f18edf4402bd1e81f64f97a7a0", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/33f091f18edf4402bd1e81f64f97a7a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/33f091f18edf4402bd1e81f64f97a7a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/33f091f18edf4402bd1e81f64f97a7a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:05:43.966454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-VolumesSnapshotsTestJSON-931261045 May 19 15:05:43.966454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 33f091f18edf4402bd1e81f64f97a7a0 May 19 15:05:43.966454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-931261045 May 19 15:05:43.966454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-VolumesSnapshotsTestJSON-931261045-project May 19 15:05:43.966454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:05:43.966454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:05:43.966454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 0eb25b3219a84d76ac31193db03fd2b3 May 19 15:05:43.966454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-VolumesSnapshotsTestJSON-931261045-project May 19 15:05:43.966454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: May 19 15:05:43.966454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. May 19 15:05:43.966454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '40f66bf0-b27a-41d2-abce-6900b239f07d'} May 19 15:05:43.966454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. (HTTP 404) (Request-ID: req-21b291d4-d3d3-4b48-afa4-3cce255230dd) May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:43.967448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 15:05:43.968875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 15:05:43.970127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:05:43.971526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. May 19 15:05:43.971526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:43.971526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:43.971526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:43.971526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:43.971526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:43.971526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:43.971526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:05:43.971526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:05:43.971526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. May 19 15:05:43.971526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:43.971526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-148d5d4a-cce8-4291-8a5e-efdadce9fdbe tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Returning 404 to user: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:05:43.971526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-148d5d4a-cce8-4291-8a5e-efdadce9fdbe tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d" status: 404 len: 109 microversion: 2.1 time: 0.117910 May 19 15:05:43.971526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 19/40] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 15:05:43 2022] GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:05:43.985957 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-563b0251-9611-4146-a6fc-063ca4bb8884 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d282f9d0>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:44.482257 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-563b0251-9611-4146-a6fc-063ca4bb8884 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] HTTP exception thrown: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-563b0251-9611-4146-a6fc-063ca4bb8884 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Request method failure captured: May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: DELETE /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d HTTP/1.1 May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihly3cqqN_aLWZxlHlFBg-m23hc3fb5yTlL37V9MpO3Nh0aVpsxKwDXlBWxqFbdGsuPg05wgBfACO2_ULhJP-RmsB1W5xzCBloPiIkEXgE6QZM_gcanvaBwM5qR3Oeo2TDmjGEHsOUR1sbEIVJVfqlPJwjDuVomdU6I6A4SEUwQkZgNo May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 33f091f18edf4402bd1e81f64f97a7a0 May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-931261045 May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:05:44.485459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:05:44.486586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_33f091f18edf4402bd1e81f64f97a7a0", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/33f091f18edf4402bd1e81f64f97a7a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/33f091f18edf4402bd1e81f64f97a7a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/33f091f18edf4402bd1e81f64f97a7a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:05:44.486586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-VolumesSnapshotsTestJSON-931261045 May 19 15:05:44.486586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 33f091f18edf4402bd1e81f64f97a7a0 May 19 15:05:44.486586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-931261045 May 19 15:05:44.486586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-VolumesSnapshotsTestJSON-931261045-project May 19 15:05:44.486586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:05:44.486586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:05:44.486586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 0eb25b3219a84d76ac31193db03fd2b3 May 19 15:05:44.486586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-VolumesSnapshotsTestJSON-931261045-project May 19 15:05:44.486586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: May 19 15:05:44.486586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. May 19 15:05:44.486586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '40f66bf0-b27a-41d2-abce-6900b239f07d'} May 19 15:05:44.486586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. (HTTP 404) (Request-ID: req-704ed9d9-89a7-452f-b215-51364c09c775) May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:44.487283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 15:05:44.488190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 15:05:44.489101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:05:44.490068 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. May 19 15:05:44.490068 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:44.490068 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:44.490068 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:44.490068 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:44.490068 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:44.490068 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:44.490068 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:05:44.490068 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:05:44.490068 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. May 19 15:05:44.490068 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:44.497880 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-563b0251-9611-4146-a6fc-063ca4bb8884 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Returning 404 to user: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:05:44.499641 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-563b0251-9611-4146-a6fc-063ca4bb8884 tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d" status: 404 len: 109 microversion: 2.1 time: 0.521202 May 19 15:05:44.504219 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 20/41] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 15:05:43 2022] DELETE /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d => generated 109 bytes in 528 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:05:44.523821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-fd685252-e135-4239-bf7e-b9197dea1afb tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Calling method '.version_select at 0x7f35d30759d0>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:44.865913 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-fd685252-e135-4239-bf7e-b9197dea1afb tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] HTTP exception thrown: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-fd685252-e135-4239-bf7e-b9197dea1afb tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Request method failure captured: May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d HTTP/1.1 May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihly3cqqN_aLWZxlHlFBg-m23hc3fb5yTlL37V9MpO3Nh0aVpsxKwDXlBWxqFbdGsuPg05wgBfACO2_ULhJP-RmsB1W5xzCBloPiIkEXgE6QZM_gcanvaBwM5qR3Oeo2TDmjGEHsOUR1sbEIVJVfqlPJwjDuVomdU6I6A4SEUwQkZgNo May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 33f091f18edf4402bd1e81f64f97a7a0 May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-931261045 May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:05:44.869763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:05:44.871082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_33f091f18edf4402bd1e81f64f97a7a0", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/33f091f18edf4402bd1e81f64f97a7a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/33f091f18edf4402bd1e81f64f97a7a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/33f091f18edf4402bd1e81f64f97a7a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:05:44.871082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-VolumesSnapshotsTestJSON-931261045 May 19 15:05:44.871082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 33f091f18edf4402bd1e81f64f97a7a0 May 19 15:05:44.871082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-931261045 May 19 15:05:44.871082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-VolumesSnapshotsTestJSON-931261045-project May 19 15:05:44.871082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:05:44.871082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:05:44.871082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 0eb25b3219a84d76ac31193db03fd2b3 May 19 15:05:44.871082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-VolumesSnapshotsTestJSON-931261045-project May 19 15:05:44.871082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: May 19 15:05:44.871082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. May 19 15:05:44.871082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '40f66bf0-b27a-41d2-abce-6900b239f07d'} May 19 15:05:44.871082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. (HTTP 404) (Request-ID: req-bd548c7c-ba10-4c55-95b4-4a891508282b) May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:44.871775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 15:05:44.872674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 15:05:44.873610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:05:44.874497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. May 19 15:05:44.874497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:44.874497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:44.874497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:44.874497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:44.874497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:44.874497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:44.874497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:05:44.874497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:05:44.874497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. May 19 15:05:44.874497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:05:44.875523 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-fd685252-e135-4239-bf7e-b9197dea1afb tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] Returning 404 to user: Volume 40f66bf0-b27a-41d2-abce-6900b239f07d could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:05:44.876754 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-fd685252-e135-4239-bf7e-b9197dea1afb tempest-VolumesSnapshotsTestJSON-931261045 tempest-VolumesSnapshotsTestJSON-931261045-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d" status: 404 len: 109 microversion: 2.1 time: 0.371001 May 19 15:05:44.877484 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 21/42] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 15:05:44 2022] GET /compute/v2.1/os-volumes/40f66bf0-b27a-41d2-abce-6900b239f07d => generated 109 bytes in 373 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:05:44.924062 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-2fcf89eb-e0f2-4804-b0b8-c95203c3e54f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:44.931920 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-2fcf89eb-e0f2-4804-b0b8-c95203c3e54f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:44.969061 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2fcf89eb-e0f2-4804-b0b8-c95203c3e54f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:44.972354 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2fcf89eb-e0f2-4804-b0b8-c95203c3e54f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:44.973261 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2fcf89eb-e0f2-4804-b0b8-c95203c3e54f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:44.978063 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2fcf89eb-e0f2-4804-b0b8-c95203c3e54f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:45.705198 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-2fcf89eb-e0f2-4804-b0b8-c95203c3e54f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:45.740754 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-2fcf89eb-e0f2-4804-b0b8-c95203c3e54f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1314 microversion: 2.1 time: 0.841797 May 19 15:05:45.746060 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 22/43] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:44 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1314 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:46.762565 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d83423c6-0a2e-4883-9248-41b2904c1c5e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:46.763333 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-d83423c6-0a2e-4883-9248-41b2904c1c5e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:46.783865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d83423c6-0a2e-4883-9248-41b2904c1c5e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:46.789093 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d83423c6-0a2e-4883-9248-41b2904c1c5e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:46.794999 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d83423c6-0a2e-4883-9248-41b2904c1c5e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:46.795528 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d83423c6-0a2e-4883-9248-41b2904c1c5e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:47.100204 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:05:47.100700 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:05:47.101858 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:05:47.102187 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:05:47.102600 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:05:47.118324 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:47.118926 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:47.119586 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:47.130381 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:47.202540 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Getting quotas for project 199f08479d9541bc936bb4ea80bae96a. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:05:47.213472 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Getting quotas for user e5374c90f38b47fcb611e346f3f2ec69 and project 199f08479d9541bc936bb4ea80bae96a. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:05:47.260793 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:05:47.279000 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:05:47.402823 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8d2958d6-e8d8-4427-a5be-178d7e1f336b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.366689 May 19 15:05:47.411763 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 22/44] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:05:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 4376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 15:05:47.443350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c0061319-9f8f-4d2e-9ffc-92cf05770c47 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:47.453029 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c0061319-9f8f-4d2e-9ffc-92cf05770c47 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:47.984611 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c0061319-9f8f-4d2e-9ffc-92cf05770c47 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:48.016691 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c0061319-9f8f-4d2e-9ffc-92cf05770c47 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1222 microversion: 2.1 time: 0.596081 May 19 15:05:48.032263 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 23/45] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:47 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1222 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:48.371426 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-d83423c6-0a2e-4883-9248-41b2904c1c5e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:48.380926 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-d83423c6-0a2e-4883-9248-41b2904c1c5e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1314 microversion: 2.1 time: 1.624436 May 19 15:05:48.391643 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 23/46] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:46 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1314 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:49.042458 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4da4cbda-db1d-4b14-8552-e4a96c88bd1c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:49.043235 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4da4cbda-db1d-4b14-8552-e4a96c88bd1c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:49.060038 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4da4cbda-db1d-4b14-8552-e4a96c88bd1c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:49.065142 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4da4cbda-db1d-4b14-8552-e4a96c88bd1c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:49.066249 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4da4cbda-db1d-4b14-8552-e4a96c88bd1c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:49.070441 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4da4cbda-db1d-4b14-8552-e4a96c88bd1c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:49.192801 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-57e1ab62-d6e8-48db-b582-fefbfb450a23 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Action: 'create', calling method: .version_select at 0x7f35d186ae50>, body: {"keypair": {"name": "tempest-keypair-2011669908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHoIUt9al+YrxNj7wbpE0BWJLlpSy+RGy6orVEraaIx48JyfWVn61/+BCIyq7jefZiM0Ia8YKsFgHbXsIRTcn9Y3YAPqPt775Z4n7HyvXbQqFSpvm+YffGX3fzN/w5l0g=="}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:05:49.243501 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-57e1ab62-d6e8-48db-b582-fefbfb450a23 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Getting quotas for project edea803526e44a55b74472ecefdb0fbc. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:05:49.258865 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-57e1ab62-d6e8-48db-b582-fefbfb450a23 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Getting quotas for user 644abe5583e94049abd23e4ca050a066 and project edea803526e44a55b74472ecefdb0fbc. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:05:49.345814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-57e1ab62-d6e8-48db-b582-fefbfb450a23 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.527035 May 19 15:05:49.348315 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 24/47] 10.222.0.24 () {62 vars in 1199 bytes} [Thu May 19 15:05:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 532 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 15:05:49.402021 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1f59c7e2-3775-4ae0-8867-e7b2031adb46 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:49.402733 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1f59c7e2-3775-4ae0-8867-e7b2031adb46 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:49.416673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1f59c7e2-3775-4ae0-8867-e7b2031adb46 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:49.419616 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1f59c7e2-3775-4ae0-8867-e7b2031adb46 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:49.422129 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1f59c7e2-3775-4ae0-8867-e7b2031adb46 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:49.423862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1f59c7e2-3775-4ae0-8867-e7b2031adb46 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:49.954427 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4da4cbda-db1d-4b14-8552-e4a96c88bd1c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:49.964739 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4da4cbda-db1d-4b14-8552-e4a96c88bd1c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1274 microversion: 2.1 time: 0.934018 May 19 15:05:49.968141 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 24/48] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:49 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1274 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:05:50.361590 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1f59c7e2-3775-4ae0-8867-e7b2031adb46 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:50.371020 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-d45d8999-89b8-4bb9-a38a-e4814bffee34 req-c9ff1a24-03e4-4b5b-b1fc-9300290f9ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d2649c-80e3-422b-9e2c-e0e946f95f17", "tag": "cd914d91-3336-4816-af6e-7033c8452477"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:05:50.385867 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1f59c7e2-3775-4ae0-8867-e7b2031adb46 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1314 microversion: 2.1 time: 0.989131 May 19 15:05:50.386475 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 25/49] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:49 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1314 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:50.402362 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-d45d8999-89b8-4bb9-a38a-e4814bffee34 req-c9ff1a24-03e4-4b5b-b1fc-9300290f9ed4 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:50.403275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-d45d8999-89b8-4bb9-a38a-e4814bffee34 req-c9ff1a24-03e4-4b5b-b1fc-9300290f9ed4 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:50.446835 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-d45d8999-89b8-4bb9-a38a-e4814bffee34 req-c9ff1a24-03e4-4b5b-b1fc-9300290f9ed4 service nova] Creating event network-changed:cd914d91-3336-4816-af6e-7033c8452477 for instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 on hv-cinder-82549 May 19 15:05:50.453421 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-d45d8999-89b8-4bb9-a38a-e4814bffee34 req-c9ff1a24-03e4-4b5b-b1fc-9300290f9ed4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117445) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 15:05:50.455158 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3d0a298e-2d6b-42d0-96c4-a3d6821bf6a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:50.455910 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3d0a298e-2d6b-42d0-96c4-a3d6821bf6a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:50.456916 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3d0a298e-2d6b-42d0-96c4-a3d6821bf6a4 None None] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:50.457575 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3d0a298e-2d6b-42d0-96c4-a3d6821bf6a4 None None] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:50.469952 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.compute.rpcapi [None req-3d0a298e-2d6b-42d0-96c4-a3d6821bf6a4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 15:05:50.471365 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3d0a298e-2d6b-42d0-96c4-a3d6821bf6a4 None None] Releasing lock "compute-rpcapi-router" {{(pid=117445) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 15:05:50.513094 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-3d0a298e-2d6b-42d0-96c4-a3d6821bf6a4 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.541569 May 19 15:05:50.514010 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 25/50] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:50.985791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5fc5b843-0ae4-4157-9047-1b7fa3040166 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:50.986411 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5fc5b843-0ae4-4157-9047-1b7fa3040166 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:51.000288 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5fc5b843-0ae4-4157-9047-1b7fa3040166 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:51.001849 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5fc5b843-0ae4-4157-9047-1b7fa3040166 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:51.006167 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5fc5b843-0ae4-4157-9047-1b7fa3040166 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:51.006881 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5fc5b843-0ae4-4157-9047-1b7fa3040166 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:51.403993 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-bfdd4c23-314e-4b86-a7b8-758d7f9ca93e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:51.404676 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-bfdd4c23-314e-4b86-a7b8-758d7f9ca93e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:51.420302 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-bfdd4c23-314e-4b86-a7b8-758d7f9ca93e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:51.420756 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-bfdd4c23-314e-4b86-a7b8-758d7f9ca93e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:51.421543 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-bfdd4c23-314e-4b86-a7b8-758d7f9ca93e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:51.436905 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-bfdd4c23-314e-4b86-a7b8-758d7f9ca93e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:51.488052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5fc5b843-0ae4-4157-9047-1b7fa3040166 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:51.502941 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5fc5b843-0ae4-4157-9047-1b7fa3040166 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1280 microversion: 2.1 time: 0.520884 May 19 15:05:51.504534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 26/51] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:50 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1280 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:52.265014 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=12 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:52.483268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-bfdd4c23-314e-4b86-a7b8-758d7f9ca93e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:52.495730 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-bfdd4c23-314e-4b86-a7b8-758d7f9ca93e tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1314 microversion: 2.1 time: 1.094357 May 19 15:05:52.518914 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 26/52] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:51 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1314 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:05:52.532853 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e703869c-9055-40ff-8599-95fcacaf13ce tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:52.542557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e703869c-9055-40ff-8599-95fcacaf13ce tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:52.549188 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e703869c-9055-40ff-8599-95fcacaf13ce tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:52.551484 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e703869c-9055-40ff-8599-95fcacaf13ce tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:52.556091 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e703869c-9055-40ff-8599-95fcacaf13ce tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:52.556740 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e703869c-9055-40ff-8599-95fcacaf13ce tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:53.435060 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-64ad915d-807a-4df4-b7dd-b005c262540d tempest-VolumesGetTestJSON-1107110724 tempest-VolumesGetTestJSON-1107110724-project] Action: 'create', calling method: .version_select at 0x7f35d17ba160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1350121463", "metadata": {"Type": "work"}}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:05:54.080487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e703869c-9055-40ff-8599-95fcacaf13ce tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:54.093366 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-64ad915d-807a-4df4-b7dd-b005c262540d tempest-VolumesGetTestJSON-1107110724 tempest-VolumesGetTestJSON-1107110724-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.738967 May 19 15:05:54.095394 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 27/53] 10.222.0.24 () {60 vars in 1155 bytes} [Thu May 19 15:05:52 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1742 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 19 15:05:54.096795 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e703869c-9055-40ff-8599-95fcacaf13ce tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1322 microversion: 2.1 time: 1.574358 May 19 15:05:54.109673 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 27/54] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:52 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1322 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:54.109978 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cff12882-391d-47e7-941a-a25846dbaa19 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:54.112895 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cff12882-391d-47e7-941a-a25846dbaa19 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:54.119166 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-986056039", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c03712e-3615-4599-bcae-117320ca4aeb"}], "security_groups": [{"name": "tempest-securitygroup--1099731415"}], "key_name": "tempest-keypair-1850093322", "user_data": "}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:05:54.122106 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cff12882-391d-47e7-941a-a25846dbaa19 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:54.122596 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cff12882-391d-47e7-941a-a25846dbaa19 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:54.123515 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cff12882-391d-47e7-941a-a25846dbaa19 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:54.124030 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cff12882-391d-47e7-941a-a25846dbaa19 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:54.627638 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.network.neutron [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] validate_networks() for [('6c03712e-3615-4599-bcae-117320ca4aeb', None, None, None, None, None)] {{(pid=117445) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:05:54.758028 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cff12882-391d-47e7-941a-a25846dbaa19 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:54.784136 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cff12882-391d-47e7-941a-a25846dbaa19 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1314 microversion: 2.1 time: 0.685792 May 19 15:05:54.806276 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 28/55] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:54 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1314 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:54.812212 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-83fa1f9a-a0ac-4053-a42a-74a2ff034de0 tempest-VolumesGetTestJSON-1107110724 tempest-VolumesGetTestJSON-1107110724-project] Calling method '.version_select at 0x7f35d17f7ca0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:54.915177 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-83fa1f9a-a0ac-4053-a42a-74a2ff034de0 tempest-VolumesGetTestJSON-1107110724 tempest-VolumesGetTestJSON-1107110724-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/31bddc42-05f6-49e7-b656-4c0c9d050f61" status: 200 len: 354 microversion: 2.1 time: 0.107078 May 19 15:05:54.916276 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 29/56] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 15:05:54 2022] GET /compute/v2.1/os-volumes/31bddc42-05f6-49e7-b656-4c0c9d050f61 => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:54.931172 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0dd318f5-2e8c-4336-a7b7-fb68448fa786 tempest-VolumesGetTestJSON-1107110724 tempest-VolumesGetTestJSON-1107110724-project] Calling method '.version_select at 0x7f35d17c5ca0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:55.039933 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0dd318f5-2e8c-4336-a7b7-fb68448fa786 tempest-VolumesGetTestJSON-1107110724 tempest-VolumesGetTestJSON-1107110724-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/31bddc42-05f6-49e7-b656-4c0c9d050f61" status: 200 len: 354 microversion: 2.1 time: 0.116465 May 19 15:05:55.040375 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 30/57] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 15:05:54 2022] GET /compute/v2.1/os-volumes/31bddc42-05f6-49e7-b656-4c0c9d050f61 => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:05:55.060508 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a70b692d-7e78-45b3-9d33-fb09b3f814b7 tempest-VolumesGetTestJSON-1107110724 tempest-VolumesGetTestJSON-1107110724-project] Calling method '.version_select at 0x7f35d17cf430>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:55.193072 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a70b692d-7e78-45b3-9d33-fb09b3f814b7 tempest-VolumesGetTestJSON-1107110724 tempest-VolumesGetTestJSON-1107110724-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/31bddc42-05f6-49e7-b656-4c0c9d050f61" status: 202 len: 0 microversion: 2.1 time: 0.137021 May 19 15:05:55.195294 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 31/58] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 15:05:55 2022] DELETE /compute/v2.1/os-volumes/31bddc42-05f6-49e7-b656-4c0c9d050f61 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 15:05:55.200720 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ccf2853d-5fb6-46fa-99b3-75b18787042f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:55.202927 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ccf2853d-5fb6-46fa-99b3-75b18787042f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:55.221695 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ccf2853d-5fb6-46fa-99b3-75b18787042f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:55.223279 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ccf2853d-5fb6-46fa-99b3-75b18787042f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:55.225621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ccf2853d-5fb6-46fa-99b3-75b18787042f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:55.226389 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ccf2853d-5fb6-46fa-99b3-75b18787042f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:56.142449 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ccf2853d-5fb6-46fa-99b3-75b18787042f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:56.163982 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ccf2853d-5fb6-46fa-99b3-75b18787042f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1322 microversion: 2.1 time: 0.965041 May 19 15:05:56.164962 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 32/59] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:55 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1322 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:56.184892 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0c9c5942-8695-45a4-89df-93395b336474 tempest-VolumesGetTestJSON-1107110724 tempest-VolumesGetTestJSON-1107110724-project] Calling method '.version_select at 0x7f35d17c55e0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:56.230848 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-0c9c5942-8695-45a4-89df-93395b336474 tempest-VolumesGetTestJSON-1107110724 tempest-VolumesGetTestJSON-1107110724-project] HTTP exception thrown: Volume 31bddc42-05f6-49e7-b656-4c0c9d050f61 could not be found. May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0c9c5942-8695-45a4-89df-93395b336474 tempest-VolumesGetTestJSON-1107110724 tempest-VolumesGetTestJSON-1107110724-project] Request method failure captured: May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/os-volumes/31bddc42-05f6-49e7-b656-4c0c9d050f61 HTTP/1.1 May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihlzQtx9oSkjaXzNskwjUZp2b5sbUcibrZmvPi_HCDTiXRo3ugnm9Z2_YRndaA49Hj-o0GZp2-lHxfLMVEgBYzf29uFbj8mDoY6U1SrozSaHxAmVGpiBIebwLaAUrUiSHZy8Cngu_hDPlCh7zMiRV8rt7CSIXH5xbQp9PnjZ0NeXWrNM May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 39d695e996c945349b16ae8ffcfd9069 May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-VolumesGetTestJSON-1107110724 May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:05:56.233248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:05:56.234584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_39d695e996c945349b16ae8ffcfd9069", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/39d695e996c945349b16ae8ffcfd9069"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/39d695e996c945349b16ae8ffcfd9069"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/39d695e996c945349b16ae8ffcfd9069"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:05:56.234584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-VolumesGetTestJSON-1107110724 May 19 15:05:56.234584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 39d695e996c945349b16ae8ffcfd9069 May 19 15:05:56.234584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-VolumesGetTestJSON-1107110724 May 19 15:05:56.234584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-VolumesGetTestJSON-1107110724-project May 19 15:05:56.234584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:05:56.234584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:05:56.234584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: 8355809cdda64843bfbdc18af1a598db May 19 15:05:56.234584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-VolumesGetTestJSON-1107110724-project May 19 15:05:56.234584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: May 19 15:05:56.234584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Volume 31bddc42-05f6-49e7-b656-4c0c9d050f61 could not be found. May 19 15:05:56.234584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': '31bddc42-05f6-49e7-b656-4c0c9d050f61'} May 19 15:05:56.234584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 31bddc42-05f6-49e7-b656-4c0c9d050f61 could not be found. (HTTP 404) (Request-ID: req-f0160581-bf86-4fb8-9107-199e9247f4f9) May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:56.235431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 15:05:56.236681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 31bddc42-05f6-49e7-b656-4c0c9d050f61 could not be found. May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 15:05:56.237673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:05:56.238882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 31bddc42-05f6-49e7-b656-4c0c9d050f61 could not be found. May 19 15:05:56.238882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:56.238882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:05:56.238882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:56.238882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:05:56.238882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:05:56.238882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:05:56.238882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:05:56.238882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:05:56.238882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 31bddc42-05f6-49e7-b656-4c0c9d050f61 could not be found. May 19 15:05:56.238882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:05:56.238882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0c9c5942-8695-45a4-89df-93395b336474 tempest-VolumesGetTestJSON-1107110724 tempest-VolumesGetTestJSON-1107110724-project] Returning 404 to user: Volume 31bddc42-05f6-49e7-b656-4c0c9d050f61 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:05:56.238882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0c9c5942-8695-45a4-89df-93395b336474 tempest-VolumesGetTestJSON-1107110724 tempest-VolumesGetTestJSON-1107110724-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/31bddc42-05f6-49e7-b656-4c0c9d050f61" status: 404 len: 109 microversion: 2.1 time: 0.068681 May 19 15:05:56.251562 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 33/60] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 15:05:56 2022] GET /compute/v2.1/os-volumes/31bddc42-05f6-49e7-b656-4c0c9d050f61 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:05:56.256692 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cf9849d7-2116-4a56-8e69-38e0902e1559 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:56.259247 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cf9849d7-2116-4a56-8e69-38e0902e1559 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:56.269981 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cf9849d7-2116-4a56-8e69-38e0902e1559 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:56.270708 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cf9849d7-2116-4a56-8e69-38e0902e1559 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:56.271681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cf9849d7-2116-4a56-8e69-38e0902e1559 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:56.272269 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cf9849d7-2116-4a56-8e69-38e0902e1559 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:56.312838 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Flavor limits 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:05:56.313820 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Image limits 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:05:56.314437 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Flavor pref 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:05:56.317103 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Image pref 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:05:56.317708 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:05:56.332811 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:56.333528 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:56.334499 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:56.337817 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:56.363497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for project 34c1099557144b8bb2fff88f5b526834. Resources: {'cores', 'instances', 'ram'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:05:56.368839 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for user af7838e525a042dfa0357ad1fc58cf21 and project 34c1099557144b8bb2fff88f5b526834. Resources: {'cores', 'instances', 'ram'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:05:56.382819 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Going to run 1 instances... {{(pid=117445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:05:56.385552 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:05:56.470782 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c472d650-6291-4d96-9165-b4420e3ec911 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.364151 May 19 15:05:56.474178 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 28/61] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:05:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 2371 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:05:56.486624 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-48fd7292-4fdc-4c77-8d62-3b2a9510adf0 req-33048b24-0c67-4462-bca0-dad2b3841bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40f607ee-2d96-4574-bed0-1462c869a91d", "tag": "60b6f5c8-3ba6-433a-ab56-de26c095f559"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:05:56.502937 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-48fd7292-4fdc-4c77-8d62-3b2a9510adf0 req-33048b24-0c67-4462-bca0-dad2b3841bc4 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:56.505065 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-48fd7292-4fdc-4c77-8d62-3b2a9510adf0 req-33048b24-0c67-4462-bca0-dad2b3841bc4 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:56.541345 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-48fd7292-4fdc-4c77-8d62-3b2a9510adf0 req-33048b24-0c67-4462-bca0-dad2b3841bc4 service nova] Creating event network-changed:60b6f5c8-3ba6-433a-ab56-de26c095f559 for instance 40f607ee-2d96-4574-bed0-1462c869a91d on hv-cinder-82549 May 19 15:05:56.558885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-48fd7292-4fdc-4c77-8d62-3b2a9510adf0 req-33048b24-0c67-4462-bca0-dad2b3841bc4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079598 May 19 15:05:56.560025 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 29/62] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:05:56.572110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-8bf7df4e-ac89-438e-bf3d-9fdbe70f8fdb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:56.577480 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-8bf7df4e-ac89-438e-bf3d-9fdbe70f8fdb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:56.919793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8bf7df4e-ac89-438e-bf3d-9fdbe70f8fdb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:56.933752 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-8bf7df4e-ac89-438e-bf3d-9fdbe70f8fdb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1241 microversion: 2.1 time: 0.369122 May 19 15:05:56.937613 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 30/63] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:56 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1241 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:57.174594 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:57.182584 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-27a567cd-7f84-4dcb-b10b-04deb5988fd8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:57.184435 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-27a567cd-7f84-4dcb-b10b-04deb5988fd8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:57.203806 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-27a567cd-7f84-4dcb-b10b-04deb5988fd8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:57.210909 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-27a567cd-7f84-4dcb-b10b-04deb5988fd8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:57.219547 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-27a567cd-7f84-4dcb-b10b-04deb5988fd8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:57.221042 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-27a567cd-7f84-4dcb-b10b-04deb5988fd8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:57.262294 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=67 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:57.354132 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cf9849d7-2116-4a56-8e69-38e0902e1559 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:57.364497 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=45 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:57.373785 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cf9849d7-2116-4a56-8e69-38e0902e1559 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1314 microversion: 2.1 time: 1.118801 May 19 15:05:57.388309 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 34/64] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:56 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1314 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:57.778205 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-27a567cd-7f84-4dcb-b10b-04deb5988fd8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:57.792185 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-27a567cd-7f84-4dcb-b10b-04deb5988fd8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1322 microversion: 2.1 time: 0.614743 May 19 15:05:57.805232 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 31/65] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:57 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1322 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:57.958672 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-252f7e2a-cb8e-482d-a782-5357aadaa3f6 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:57.960806 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-252f7e2a-cb8e-482d-a782-5357aadaa3f6 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:57.977054 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=8 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:57.984827 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-252f7e2a-cb8e-482d-a782-5357aadaa3f6 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:57.988167 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-252f7e2a-cb8e-482d-a782-5357aadaa3f6 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:57.991847 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-252f7e2a-cb8e-482d-a782-5357aadaa3f6 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:57.999243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-252f7e2a-cb8e-482d-a782-5357aadaa3f6 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:58.353544 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-252f7e2a-cb8e-482d-a782-5357aadaa3f6 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:58.363000 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-252f7e2a-cb8e-482d-a782-5357aadaa3f6 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1293 microversion: 2.1 time: 0.412667 May 19 15:05:58.378562 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 35/66] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:57 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1293 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:58.393252 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-50487800-69ce-4d67-a05f-95ade97fee20 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:58.394099 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-50487800-69ce-4d67-a05f-95ade97fee20 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:58.396126 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:58.406894 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-50487800-69ce-4d67-a05f-95ade97fee20 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:58.410549 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-50487800-69ce-4d67-a05f-95ade97fee20 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:58.411628 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-50487800-69ce-4d67-a05f-95ade97fee20 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:58.419000 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-50487800-69ce-4d67-a05f-95ade97fee20 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:58.817502 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f9d03540-b64e-48d7-b2a3-2ef43b4c1f05 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:58.819364 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f9d03540-b64e-48d7-b2a3-2ef43b4c1f05 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:58.848039 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f9d03540-b64e-48d7-b2a3-2ef43b4c1f05 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:58.848622 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f9d03540-b64e-48d7-b2a3-2ef43b4c1f05 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:58.851938 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f9d03540-b64e-48d7-b2a3-2ef43b4c1f05 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:58.852408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f9d03540-b64e-48d7-b2a3-2ef43b4c1f05 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:59.293713 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=24 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:05:59.696525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f9d03540-b64e-48d7-b2a3-2ef43b4c1f05 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:59.706890 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f9d03540-b64e-48d7-b2a3-2ef43b4c1f05 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1322 microversion: 2.1 time: 0.899881 May 19 15:05:59.707471 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 36/67] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:58 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1322 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:05:59.713368 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c2c7eaa9-8f48-4f38-ad11-5a3b05b09b2e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:05:59.714169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c2c7eaa9-8f48-4f38-ad11-5a3b05b09b2e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:05:59.717776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-50487800-69ce-4d67-a05f-95ade97fee20 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:05:59.721129 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c2c7eaa9-8f48-4f38-ad11-5a3b05b09b2e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:59.721766 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c2c7eaa9-8f48-4f38-ad11-5a3b05b09b2e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:59.722701 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c2c7eaa9-8f48-4f38-ad11-5a3b05b09b2e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:05:59.723390 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c2c7eaa9-8f48-4f38-ad11-5a3b05b09b2e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:05:59.738317 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-50487800-69ce-4d67-a05f-95ade97fee20 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1314 microversion: 2.1 time: 1.348086 May 19 15:05:59.742029 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 32/68] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:58 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1314 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:00.074716 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c2c7eaa9-8f48-4f38-ad11-5a3b05b09b2e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:00.100697 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c2c7eaa9-8f48-4f38-ad11-5a3b05b09b2e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1299 microversion: 2.1 time: 0.391268 May 19 15:06:00.108895 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 37/69] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:05:59 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1299 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:00.434143 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-2979b03c-0675-4b01-8fa4-14f27197e34c req-90852806-d9dc-4fe8-95de-8bcf7f69facb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1724bc45-95a0-405b-ac06-8e4ffe410b21", "tag": "58f5d4b7-8286-4eb3-93b6-351b6f5288ae"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:06:00.450944 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-2979b03c-0675-4b01-8fa4-14f27197e34c req-90852806-d9dc-4fe8-95de-8bcf7f69facb service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:00.451434 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-2979b03c-0675-4b01-8fa4-14f27197e34c req-90852806-d9dc-4fe8-95de-8bcf7f69facb service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:00.497632 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-2979b03c-0675-4b01-8fa4-14f27197e34c req-90852806-d9dc-4fe8-95de-8bcf7f69facb service nova] Creating event network-changed:58f5d4b7-8286-4eb3-93b6-351b6f5288ae for instance 1724bc45-95a0-405b-ac06-8e4ffe410b21 on hv-cinder-82549 May 19 15:06:00.514817 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-2979b03c-0675-4b01-8fa4-14f27197e34c req-90852806-d9dc-4fe8-95de-8bcf7f69facb service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436697 May 19 15:06:00.517920 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 33/70] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:06:00.724067 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a4d3ecf4-0424-40f2-9d90-7a1d82ac3d81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:00.724688 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a4d3ecf4-0424-40f2-9d90-7a1d82ac3d81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:00.738279 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4d3ecf4-0424-40f2-9d90-7a1d82ac3d81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:00.738279 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4d3ecf4-0424-40f2-9d90-7a1d82ac3d81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:00.740821 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4d3ecf4-0424-40f2-9d90-7a1d82ac3d81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:00.741852 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4d3ecf4-0424-40f2-9d90-7a1d82ac3d81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:00.767327 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3ee0a54a-d3b9-4e35-821a-b317e2a9031d tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:00.770690 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-3ee0a54a-d3b9-4e35-821a-b317e2a9031d tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:00.791622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3ee0a54a-d3b9-4e35-821a-b317e2a9031d tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:00.793710 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3ee0a54a-d3b9-4e35-821a-b317e2a9031d tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:00.796836 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3ee0a54a-d3b9-4e35-821a-b317e2a9031d tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:00.797349 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3ee0a54a-d3b9-4e35-821a-b317e2a9031d tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:01.097455 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a4d3ecf4-0424-40f2-9d90-7a1d82ac3d81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:01.106489 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a4d3ecf4-0424-40f2-9d90-7a1d82ac3d81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1322 microversion: 2.1 time: 0.386254 May 19 15:06:01.122675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 38/71] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:00 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:01.136898 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1329153295", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aaadbb67-bc9d-4c4f-a511-c571d677d8f0"}], "security_groups": [{"name": "tempest-securitygroup--797710511"}], "key_name": "tempest-keypair-2011669908", "user_data": "}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:06:01.187101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-3ee0a54a-d3b9-4e35-821a-b317e2a9031d tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:01.197973 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-3ee0a54a-d3b9-4e35-821a-b317e2a9031d tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1314 microversion: 2.1 time: 0.444321 May 19 15:06:01.199029 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 34/72] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:00 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:01.214295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-42a79ab9-c4f8-4943-9be2-d54b26011fa2 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:01.219014 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-42a79ab9-c4f8-4943-9be2-d54b26011fa2 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:01.232212 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-42a79ab9-c4f8-4943-9be2-d54b26011fa2 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:01.232698 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-42a79ab9-c4f8-4943-9be2-d54b26011fa2 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:01.233497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-42a79ab9-c4f8-4943-9be2-d54b26011fa2 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:01.234053 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-42a79ab9-c4f8-4943-9be2-d54b26011fa2 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:01.360624 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] validate_networks() for [('aaadbb67-bc9d-4c4f-a511-c571d677d8f0', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:06:01.712171 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-42a79ab9-c4f8-4943-9be2-d54b26011fa2 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:01.725749 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-42a79ab9-c4f8-4943-9be2-d54b26011fa2 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1367 microversion: 2.1 time: 0.525496 May 19 15:06:01.733062 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 35/73] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:01 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1367 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:02.268762 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-a7766e64-3134-437e-a92a-63b171b580cf req-a224bd32-dc4e-41b7-b905-d7b5d88cb5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d2649c-80e3-422b-9e2c-e0e946f95f17", "name": "network-vif-plugged", "status": "completed", "tag": "cd914d91-3336-4816-af6e-7033c8452477"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:06:02.287562 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-a7766e64-3134-437e-a92a-63b171b580cf req-a224bd32-dc4e-41b7-b905-d7b5d88cb5b3 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:02.290556 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-a7766e64-3134-437e-a92a-63b171b580cf req-a224bd32-dc4e-41b7-b905-d7b5d88cb5b3 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:02.338964 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-a7766e64-3134-437e-a92a-63b171b580cf req-a224bd32-dc4e-41b7-b905-d7b5d88cb5b3 service nova] Creating event network-vif-plugged:cd914d91-3336-4816-af6e-7033c8452477 for instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 on hv-cinder-82549 May 19 15:06:02.357026 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-a7766e64-3134-437e-a92a-63b171b580cf req-a224bd32-dc4e-41b7-b905-d7b5d88cb5b3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.621020 May 19 15:06:02.360109 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 36/74] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:06:02.385411 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9a654c7a-77e9-42f2-a9b5-74d0645efaa5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:02.393102 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-9a654c7a-77e9-42f2-a9b5-74d0645efaa5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:02.404862 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9a654c7a-77e9-42f2-a9b5-74d0645efaa5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:02.410373 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9a654c7a-77e9-42f2-a9b5-74d0645efaa5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:02.411661 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9a654c7a-77e9-42f2-a9b5-74d0645efaa5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:02.412316 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9a654c7a-77e9-42f2-a9b5-74d0645efaa5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:02.686527 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:06:02.687794 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:06:02.688251 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:06:02.689441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:06:02.690318 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:06:02.718642 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:02.719069 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:02.719931 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:02.720350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:02.791771 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Getting quotas for project edea803526e44a55b74472ecefdb0fbc. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:06:02.796463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Getting quotas for user 644abe5583e94049abd23e4ca050a066 and project edea803526e44a55b74472ecefdb0fbc. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:06:02.848813 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:06:02.856745 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:06:02.966866 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-76c96fb2-2b7f-4738-ae5c-51685038b66c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.843170 May 19 15:06:02.972845 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 39/75] 10.222.0.24 () {62 vars in 1187 bytes} [Thu May 19 15:06:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 15:06:02.993114 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4d43d1cc-6681-4553-ad56-c2adfb71b493 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:02.993771 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4d43d1cc-6681-4553-ad56-c2adfb71b493 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:03.020234 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4d43d1cc-6681-4553-ad56-c2adfb71b493 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:03.020234 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4d43d1cc-6681-4553-ad56-c2adfb71b493 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:03.020234 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4d43d1cc-6681-4553-ad56-c2adfb71b493 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:03.020234 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4d43d1cc-6681-4553-ad56-c2adfb71b493 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:03.139767 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9a654c7a-77e9-42f2-a9b5-74d0645efaa5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:03.149899 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9a654c7a-77e9-42f2-a9b5-74d0645efaa5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1322 microversion: 2.1 time: 0.788364 May 19 15:06:03.155996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 37/76] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:02 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1322 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:03.188705 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-549d554a-f0db-4f2f-9413-a774a227a73b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:03.189689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-549d554a-f0db-4f2f-9413-a774a227a73b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:03.199415 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-549d554a-f0db-4f2f-9413-a774a227a73b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:03.204392 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-549d554a-f0db-4f2f-9413-a774a227a73b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:03.205737 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-549d554a-f0db-4f2f-9413-a774a227a73b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:03.206497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-549d554a-f0db-4f2f-9413-a774a227a73b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:03.714420 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-549d554a-f0db-4f2f-9413-a774a227a73b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:03.727838 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-549d554a-f0db-4f2f-9413-a774a227a73b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1367 microversion: 2.1 time: 0.557628 May 19 15:06:03.731151 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 38/77] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:03 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1367 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:03.759192 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3d1eaf53-841f-4a21-917d-a1a90c0c7e54 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:03.759936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-3d1eaf53-841f-4a21-917d-a1a90c0c7e54 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:03.778884 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4d43d1cc-6681-4553-ad56-c2adfb71b493 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:03.787782 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4d43d1cc-6681-4553-ad56-c2adfb71b493 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1314 microversion: 2.1 time: 0.813736 May 19 15:06:03.805824 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 40/78] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:02 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1314 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:03.819583 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-3d653c9a-73f2-4814-994e-a149c984ea18 req-549a6a5e-5a02-4e2b-8bb3-b6cdc59b1c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3", "tag": "99e00ce6-f671-4c78-ab3b-e03e6a5532ed"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:06:03.843641 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-3d653c9a-73f2-4814-994e-a149c984ea18 req-549a6a5e-5a02-4e2b-8bb3-b6cdc59b1c8d service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:03.844378 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-3d653c9a-73f2-4814-994e-a149c984ea18 req-549a6a5e-5a02-4e2b-8bb3-b6cdc59b1c8d service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:03.850506 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-3d1eaf53-841f-4a21-917d-a1a90c0c7e54 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:03.858490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-3d1eaf53-841f-4a21-917d-a1a90c0c7e54 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:03.863230 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-3d1eaf53-841f-4a21-917d-a1a90c0c7e54 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:03.871982 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-3d653c9a-73f2-4814-994e-a149c984ea18 req-549a6a5e-5a02-4e2b-8bb3-b6cdc59b1c8d service nova] Creating event network-changed:99e00ce6-f671-4c78-ab3b-e03e6a5532ed for instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 on hv-cinder-82549 May 19 15:06:03.872506 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-3d1eaf53-841f-4a21-917d-a1a90c0c7e54 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1282 microversion: 2.20 time: 0.125638 May 19 15:06:03.873357 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-3d653c9a-73f2-4814-994e-a149c984ea18 req-549a6a5e-5a02-4e2b-8bb3-b6cdc59b1c8d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 15:06:03.873956 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 39/79] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:06:03 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1282 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:06:03.875799 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99b33509-7e7d-45de-800f-d0690ee02760 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:03.877814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99b33509-7e7d-45de-800f-d0690ee02760 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:03.879095 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99b33509-7e7d-45de-800f-d0690ee02760 None None] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:03.879837 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99b33509-7e7d-45de-800f-d0690ee02760 None None] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:03.896582 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.compute.rpcapi [None req-99b33509-7e7d-45de-800f-d0690ee02760 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 15:06:03.897784 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-99b33509-7e7d-45de-800f-d0690ee02760 None None] Releasing lock "compute-rpcapi-router" {{(pid=117444) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 15:06:03.926700 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-99b33509-7e7d-45de-800f-d0690ee02760 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119186 May 19 15:06:03.927487 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 41/80] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:06:04.172404 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-5c6bb50a-8c97-41d8-8f03-58a5f869e414 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:04.173018 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-5c6bb50a-8c97-41d8-8f03-58a5f869e414 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:04.185719 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5c6bb50a-8c97-41d8-8f03-58a5f869e414 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:04.186760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5c6bb50a-8c97-41d8-8f03-58a5f869e414 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:04.187586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5c6bb50a-8c97-41d8-8f03-58a5f869e414 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:04.188029 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5c6bb50a-8c97-41d8-8f03-58a5f869e414 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:04.416193 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-a47f0d08-f327-49db-928b-9424c777608c req-1c1d8b36-0bee-4213-98fe-1d5af9007ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f607ee-2d96-4574-bed0-1462c869a91d", "name": "network-vif-plugged", "status": "completed", "tag": "60b6f5c8-3ba6-433a-ab56-de26c095f559"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:06:04.434921 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-a47f0d08-f327-49db-928b-9424c777608c req-1c1d8b36-0bee-4213-98fe-1d5af9007ab6 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:04.435670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-a47f0d08-f327-49db-928b-9424c777608c req-1c1d8b36-0bee-4213-98fe-1d5af9007ab6 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:04.448016 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-a47f0d08-f327-49db-928b-9424c777608c req-1c1d8b36-0bee-4213-98fe-1d5af9007ab6 service nova] Creating event network-vif-plugged:60b6f5c8-3ba6-433a-ab56-de26c095f559 for instance 40f607ee-2d96-4574-bed0-1462c869a91d on hv-cinder-82549 May 19 15:06:04.453426 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-a47f0d08-f327-49db-928b-9424c777608c req-1c1d8b36-0bee-4213-98fe-1d5af9007ab6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043899 May 19 15:06:04.454038 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 42/81] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:06:04.610517 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5c6bb50a-8c97-41d8-8f03-58a5f869e414 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:04.619440 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-5c6bb50a-8c97-41d8-8f03-58a5f869e414 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1322 microversion: 2.1 time: 0.450709 May 19 15:06:04.620274 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 40/82] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:04 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:04.750438 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a553bb34-61c0-484c-ba33-5d021658b61b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:04.752382 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a553bb34-61c0-484c-ba33-5d021658b61b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:04.762330 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a553bb34-61c0-484c-ba33-5d021658b61b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:04.763184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a553bb34-61c0-484c-ba33-5d021658b61b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:04.764297 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a553bb34-61c0-484c-ba33-5d021658b61b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:04.765035 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a553bb34-61c0-484c-ba33-5d021658b61b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:04.822752 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-0167c1fa-c68c-4366-b9cc-da5393c2d3be tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:04.823699 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-0167c1fa-c68c-4366-b9cc-da5393c2d3be tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:04.839016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0167c1fa-c68c-4366-b9cc-da5393c2d3be tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:04.840612 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0167c1fa-c68c-4366-b9cc-da5393c2d3be tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:04.841406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0167c1fa-c68c-4366-b9cc-da5393c2d3be tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:04.843428 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0167c1fa-c68c-4366-b9cc-da5393c2d3be tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:05.183657 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-0167c1fa-c68c-4366-b9cc-da5393c2d3be tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:05.186895 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a553bb34-61c0-484c-ba33-5d021658b61b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:05.195946 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a553bb34-61c0-484c-ba33-5d021658b61b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1367 microversion: 2.1 time: 0.452980 May 19 15:06:05.196849 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 43/83] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:04 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1367 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:05.201034 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-0167c1fa-c68c-4366-b9cc-da5393c2d3be tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1314 microversion: 2.1 time: 0.382877 May 19 15:06:05.201415 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d55d5705-3dff-460c-9252-0300ba9ac0dc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:05.202188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d55d5705-3dff-460c-9252-0300ba9ac0dc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:05.203905 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 41/84] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:04 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:06:05.208507 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d55d5705-3dff-460c-9252-0300ba9ac0dc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:05.209437 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d55d5705-3dff-460c-9252-0300ba9ac0dc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:05.211104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d55d5705-3dff-460c-9252-0300ba9ac0dc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:05.211577 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d55d5705-3dff-460c-9252-0300ba9ac0dc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:05.298321 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d55d5705-3dff-460c-9252-0300ba9ac0dc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:05.309990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d55d5705-3dff-460c-9252-0300ba9ac0dc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:05.312544 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d55d5705-3dff-460c-9252-0300ba9ac0dc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:05.317411 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d55d5705-3dff-460c-9252-0300ba9ac0dc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1342 microversion: 2.20 time: 0.119412 May 19 15:06:05.318151 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 44/85] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:06:05 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1342 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:06:05.638503 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e26c5c0e-3dc3-4a29-9bb9-596097d8aa52 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:05.639115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e26c5c0e-3dc3-4a29-9bb9-596097d8aa52 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:05.646476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e26c5c0e-3dc3-4a29-9bb9-596097d8aa52 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:05.647015 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e26c5c0e-3dc3-4a29-9bb9-596097d8aa52 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:05.648564 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e26c5c0e-3dc3-4a29-9bb9-596097d8aa52 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:05.649220 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e26c5c0e-3dc3-4a29-9bb9-596097d8aa52 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:05.862536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e26c5c0e-3dc3-4a29-9bb9-596097d8aa52 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:05.874208 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e26c5c0e-3dc3-4a29-9bb9-596097d8aa52 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1322 microversion: 2.1 time: 0.240211 May 19 15:06:05.875025 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 42/86] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:05 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:06.213579 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4cd1c6df-d29f-4921-932e-ada886125fa4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:06.214197 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4cd1c6df-d29f-4921-932e-ada886125fa4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:06.221685 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d505ebc9-5fdc-451b-b57b-4ccc0677bed3 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:06.222401 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-d505ebc9-5fdc-451b-b57b-4ccc0677bed3 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:06.226410 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cd1c6df-d29f-4921-932e-ada886125fa4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:06.229441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cd1c6df-d29f-4921-932e-ada886125fa4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:06.230330 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cd1c6df-d29f-4921-932e-ada886125fa4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:06.230794 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cd1c6df-d29f-4921-932e-ada886125fa4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:06.231363 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d505ebc9-5fdc-451b-b57b-4ccc0677bed3 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:06.232223 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d505ebc9-5fdc-451b-b57b-4ccc0677bed3 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:06.233261 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d505ebc9-5fdc-451b-b57b-4ccc0677bed3 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:06.233939 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d505ebc9-5fdc-451b-b57b-4ccc0677bed3 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:06.353757 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=6 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:06.489558 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-d505ebc9-5fdc-451b-b57b-4ccc0677bed3 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:06.507829 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-d505ebc9-5fdc-451b-b57b-4ccc0677bed3 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1502 microversion: 2.1 time: 0.293741 May 19 15:06:06.508424 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 43/87] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:06 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1502 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:06.526477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-cc2f240b-2618-499a-a12d-f3913461d4de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:06.527171 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-cc2f240b-2618-499a-a12d-f3913461d4de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:06.531879 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4cd1c6df-d29f-4921-932e-ada886125fa4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:06.545066 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cc2f240b-2618-499a-a12d-f3913461d4de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:06.545535 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cc2f240b-2618-499a-a12d-f3913461d4de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:06.548391 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4cd1c6df-d29f-4921-932e-ada886125fa4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1367 microversion: 2.1 time: 0.337275 May 19 15:06:06.549010 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 45/88] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:06 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:06.550216 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cc2f240b-2618-499a-a12d-f3913461d4de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:06.550718 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cc2f240b-2618-499a-a12d-f3913461d4de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:06.577627 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-35266b7c-b7d0-4642-ac7d-ec70389c1890 req-7a584c19-8d66-4d07-a34c-c8f1165be8e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1724bc45-95a0-405b-ac06-8e4ffe410b21", "name": "network-vif-plugged", "status": "completed", "tag": "58f5d4b7-8286-4eb3-93b6-351b6f5288ae"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:06:06.588952 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-35266b7c-b7d0-4642-ac7d-ec70389c1890 req-7a584c19-8d66-4d07-a34c-c8f1165be8e2 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:06.589497 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-35266b7c-b7d0-4642-ac7d-ec70389c1890 req-7a584c19-8d66-4d07-a34c-c8f1165be8e2 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:06.606501 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-35266b7c-b7d0-4642-ac7d-ec70389c1890 req-7a584c19-8d66-4d07-a34c-c8f1165be8e2 service nova] Creating event network-vif-plugged:58f5d4b7-8286-4eb3-93b6-351b6f5288ae for instance 1724bc45-95a0-405b-ac06-8e4ffe410b21 on hv-cinder-82549 May 19 15:06:06.615980 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-35266b7c-b7d0-4642-ac7d-ec70389c1890 req-7a584c19-8d66-4d07-a34c-c8f1165be8e2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054118 May 19 15:06:06.617929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 46/89] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:06:06.737541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-cc2f240b-2618-499a-a12d-f3913461d4de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:06.751144 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-cc2f240b-2618-499a-a12d-f3913461d4de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:06.754766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-cc2f240b-2618-499a-a12d-f3913461d4de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:06.757212 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-cc2f240b-2618-499a-a12d-f3913461d4de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1342 microversion: 2.20 time: 0.246136 May 19 15:06:06.759715 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 44/90] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:06:06 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1342 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:06:06.893288 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-85f8e3fa-19b4-41f0-b70c-e5d9cf771436 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:06.894629 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-85f8e3fa-19b4-41f0-b70c-e5d9cf771436 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:06.907600 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85f8e3fa-19b4-41f0-b70c-e5d9cf771436 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:06.909059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85f8e3fa-19b4-41f0-b70c-e5d9cf771436 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:06.913472 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85f8e3fa-19b4-41f0-b70c-e5d9cf771436 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:06.914107 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85f8e3fa-19b4-41f0-b70c-e5d9cf771436 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:07.398382 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-85f8e3fa-19b4-41f0-b70c-e5d9cf771436 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:07.438398 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-85f8e3fa-19b4-41f0-b70c-e5d9cf771436 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1322 microversion: 2.1 time: 0.549547 May 19 15:06:07.439527 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 47/91] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:06 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1322 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:07.566471 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-024b2259-8c52-4eb5-8624-2203b8c731f1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:07.566471 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-024b2259-8c52-4eb5-8624-2203b8c731f1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:07.586870 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-024b2259-8c52-4eb5-8624-2203b8c731f1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:07.587370 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-024b2259-8c52-4eb5-8624-2203b8c731f1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:07.588151 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-024b2259-8c52-4eb5-8624-2203b8c731f1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:07.590554 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-024b2259-8c52-4eb5-8624-2203b8c731f1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:07.781334 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cc0c5485-d859-48ad-a2b9-d76806df50fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:07.782023 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cc0c5485-d859-48ad-a2b9-d76806df50fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:07.794586 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc0c5485-d859-48ad-a2b9-d76806df50fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:07.795057 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc0c5485-d859-48ad-a2b9-d76806df50fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:07.797107 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc0c5485-d859-48ad-a2b9-d76806df50fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:07.797551 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc0c5485-d859-48ad-a2b9-d76806df50fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:07.900893 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-024b2259-8c52-4eb5-8624-2203b8c731f1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:07.909646 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-024b2259-8c52-4eb5-8624-2203b8c731f1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1367 microversion: 2.1 time: 0.347749 May 19 15:06:07.920263 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 45/92] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:07 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:07.941553 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cc0c5485-d859-48ad-a2b9-d76806df50fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:07.950510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cc0c5485-d859-48ad-a2b9-d76806df50fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:07.952061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cc0c5485-d859-48ad-a2b9-d76806df50fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:07.953254 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cc0c5485-d859-48ad-a2b9-d76806df50fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1340 microversion: 2.20 time: 0.176698 May 19 15:06:07.955288 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 48/93] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:06:07 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1340 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:06:08.230269 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-1d88e940-c340-4b02-94fc-147acb490965 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c354d500-b251-40a0-90d3-e1f9d97c7db3"}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:06:08.231954 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-1d88e940-c340-4b02-94fc-147acb490965 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:08.246151 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1d88e940-c340-4b02-94fc-147acb490965 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:08.246607 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1d88e940-c340-4b02-94fc-147acb490965 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:08.247433 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1d88e940-c340-4b02-94fc-147acb490965 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:08.247867 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1d88e940-c340-4b02-94fc-147acb490965 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:08.456872 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5d5f9df7-0a0b-4370-b16f-6fa15b633baf tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:08.458258 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5d5f9df7-0a0b-4370-b16f-6fa15b633baf tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:08.478550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5d5f9df7-0a0b-4370-b16f-6fa15b633baf tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:08.478998 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5d5f9df7-0a0b-4370-b16f-6fa15b633baf tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:08.485253 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5d5f9df7-0a0b-4370-b16f-6fa15b633baf tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:08.485707 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5d5f9df7-0a0b-4370-b16f-6fa15b633baf tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:08.934362 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5d5f9df7-0a0b-4370-b16f-6fa15b633baf tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:08.961368 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5d5f9df7-0a0b-4370-b16f-6fa15b633baf tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1515 microversion: 2.1 time: 0.505913 May 19 15:06:08.963306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 49/94] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:08 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1515 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:06:08.980451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-247ef4d8-ddc0-455e-8159-6cd416be2490 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:08.981472 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-247ef4d8-ddc0-455e-8159-6cd416be2490 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:08.999157 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-247ef4d8-ddc0-455e-8159-6cd416be2490 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:09.000905 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-247ef4d8-ddc0-455e-8159-6cd416be2490 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:09.006865 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-247ef4d8-ddc0-455e-8159-6cd416be2490 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:09.007383 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-247ef4d8-ddc0-455e-8159-6cd416be2490 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:09.255493 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-1d88e940-c340-4b02-94fc-147acb490965 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "POST /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.025471 May 19 15:06:09.257309 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 46/95] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 15:06:08 2022] POST /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17/os-volume_attachments => generated 194 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:06:09.272477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-895a372e-e1bc-49b1-b186-df58380f2eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:09.273398 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-895a372e-e1bc-49b1-b186-df58380f2eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:09.284994 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-895a372e-e1bc-49b1-b186-df58380f2eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:09.285458 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-895a372e-e1bc-49b1-b186-df58380f2eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:09.286439 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-895a372e-e1bc-49b1-b186-df58380f2eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:09.287261 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-895a372e-e1bc-49b1-b186-df58380f2eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:09.395852 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-247ef4d8-ddc0-455e-8159-6cd416be2490 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:09.404721 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-247ef4d8-ddc0-455e-8159-6cd416be2490 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1367 microversion: 2.1 time: 0.440241 May 19 15:06:09.414603 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 50/96] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:08 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1367 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:09.419885 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c7707aac-f88e-4880-bd13-bdd1fb850054 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:06:09.420928 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c7707aac-f88e-4880-bd13-bdd1fb850054 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:09.427526 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7707aac-f88e-4880-bd13-bdd1fb850054 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:09.428343 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7707aac-f88e-4880-bd13-bdd1fb850054 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:09.429328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7707aac-f88e-4880-bd13-bdd1fb850054 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:09.429786 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7707aac-f88e-4880-bd13-bdd1fb850054 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:09.517904 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-c7707aac-f88e-4880-bd13-bdd1fb850054 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lazy-loading 'flavor' on Instance uuid 40f607ee-2d96-4574-bed0-1462c869a91d {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:06:09.852274 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:10.085798 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-895a372e-e1bc-49b1-b186-df58380f2eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:10.097590 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-895a372e-e1bc-49b1-b186-df58380f2eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:10.100912 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-895a372e-e1bc-49b1-b186-df58380f2eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:10.105081 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-895a372e-e1bc-49b1-b186-df58380f2eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1407 microversion: 2.20 time: 0.845761 May 19 15:06:10.110312 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 47/97] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:06:09 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1407 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:06:10.133819 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-e4827b4d-ddd4-42fe-9a90-98022e5e5ab9 req-181cc75e-4927-4f1f-ba3c-b4df6c11873e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6324753a-5912-42c2-a1f4-0bc631bea605", "tag": "3beaa750-59c9-4ce6-b188-390d70f3fb7a"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:06:10.163760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-e4827b4d-ddd4-42fe-9a90-98022e5e5ab9 req-181cc75e-4927-4f1f-ba3c-b4df6c11873e service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:10.168115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-e4827b4d-ddd4-42fe-9a90-98022e5e5ab9 req-181cc75e-4927-4f1f-ba3c-b4df6c11873e service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:10.202098 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-e4827b4d-ddd4-42fe-9a90-98022e5e5ab9 req-181cc75e-4927-4f1f-ba3c-b4df6c11873e service nova] Creating event network-changed:3beaa750-59c9-4ce6-b188-390d70f3fb7a for instance 6324753a-5912-42c2-a1f4-0bc631bea605 on hv-cinder-82549 May 19 15:06:10.229033 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-e4827b4d-ddd4-42fe-9a90-98022e5e5ab9 req-181cc75e-4927-4f1f-ba3c-b4df6c11873e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106665 May 19 15:06:10.229649 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 48/98] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:06:10.320335 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c7707aac-f88e-4880-bd13-bdd1fb850054 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "POST /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d/action" status: 200 len: 32 microversion: 2.1 time: 0.904225 May 19 15:06:10.321196 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 51/99] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 15:06:09 2022] POST /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d/action => generated 32 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 15:06:10.335327 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-85e87e59-77f2-459d-9b4c-0bb9eb4fae72 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:10.336054 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-85e87e59-77f2-459d-9b4c-0bb9eb4fae72 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:10.352766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-85e87e59-77f2-459d-9b4c-0bb9eb4fae72 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:10.353548 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-85e87e59-77f2-459d-9b4c-0bb9eb4fae72 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:10.354760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-85e87e59-77f2-459d-9b4c-0bb9eb4fae72 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:10.355794 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-85e87e59-77f2-459d-9b4c-0bb9eb4fae72 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:10.424286 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7f70d8c3-eaca-4788-a2f2-07c2a7313276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:10.425092 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7f70d8c3-eaca-4788-a2f2-07c2a7313276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:10.435600 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7f70d8c3-eaca-4788-a2f2-07c2a7313276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:10.436055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7f70d8c3-eaca-4788-a2f2-07c2a7313276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:10.437032 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7f70d8c3-eaca-4788-a2f2-07c2a7313276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:10.437653 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7f70d8c3-eaca-4788-a2f2-07c2a7313276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:10.792763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-85e87e59-77f2-459d-9b4c-0bb9eb4fae72 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:10.795940 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:10.810317 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-85e87e59-77f2-459d-9b4c-0bb9eb4fae72 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.483652 May 19 15:06:10.813102 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 49/100] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:10 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:10.826329 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-efea5600-0b57-4ccc-bac7-93bd78b7f415 req-80f2bb17-3755-4a22-917c-28f77e9cd4ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3", "name": "network-vif-plugged", "status": "completed", "tag": "99e00ce6-f671-4c78-ab3b-e03e6a5532ed"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:06:10.855112 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-efea5600-0b57-4ccc-bac7-93bd78b7f415 req-80f2bb17-3755-4a22-917c-28f77e9cd4ff service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:10.855709 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-efea5600-0b57-4ccc-bac7-93bd78b7f415 req-80f2bb17-3755-4a22-917c-28f77e9cd4ff service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:10.869472 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-efea5600-0b57-4ccc-bac7-93bd78b7f415 req-80f2bb17-3755-4a22-917c-28f77e9cd4ff service nova] Creating event network-vif-plugged:99e00ce6-f671-4c78-ab3b-e03e6a5532ed for instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 on hv-cinder-82549 May 19 15:06:10.879506 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-efea5600-0b57-4ccc-bac7-93bd78b7f415 req-80f2bb17-3755-4a22-917c-28f77e9cd4ff service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063803 May 19 15:06:10.880580 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 50/101] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:06:10.956770 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7f70d8c3-eaca-4788-a2f2-07c2a7313276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:10.965346 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7f70d8c3-eaca-4788-a2f2-07c2a7313276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1367 microversion: 2.1 time: 0.546922 May 19 15:06:10.980222 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 52/102] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:10 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1367 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:11.128448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f2d0bb2d-1103-4187-8ec2-32386428166d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:11.129143 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f2d0bb2d-1103-4187-8ec2-32386428166d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:11.137854 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f2d0bb2d-1103-4187-8ec2-32386428166d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:11.138518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f2d0bb2d-1103-4187-8ec2-32386428166d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:11.139461 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f2d0bb2d-1103-4187-8ec2-32386428166d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:11.140044 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f2d0bb2d-1103-4187-8ec2-32386428166d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:11.334182 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f2d0bb2d-1103-4187-8ec2-32386428166d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:11.351675 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f2d0bb2d-1103-4187-8ec2-32386428166d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:11.353325 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f2d0bb2d-1103-4187-8ec2-32386428166d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:11.354475 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f2d0bb2d-1103-4187-8ec2-32386428166d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1407 microversion: 2.20 time: 0.230776 May 19 15:06:11.355036 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 51/103] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:06:11 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:06:11.829934 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7fd20b3f-bd52-4f00-88a7-dc1b00c8aca4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:11.830809 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7fd20b3f-bd52-4f00-88a7-dc1b00c8aca4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:11.845845 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7fd20b3f-bd52-4f00-88a7-dc1b00c8aca4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:11.846500 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7fd20b3f-bd52-4f00-88a7-dc1b00c8aca4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:11.847193 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7fd20b3f-bd52-4f00-88a7-dc1b00c8aca4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:11.847808 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7fd20b3f-bd52-4f00-88a7-dc1b00c8aca4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:11.985413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-12cbedff-b10d-431d-ba53-cc4a2bd03a96 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:11.985413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-12cbedff-b10d-431d-ba53-cc4a2bd03a96 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:11.993101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-12cbedff-b10d-431d-ba53-cc4a2bd03a96 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:11.993850 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-12cbedff-b10d-431d-ba53-cc4a2bd03a96 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:11.994780 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-12cbedff-b10d-431d-ba53-cc4a2bd03a96 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:11.995429 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-12cbedff-b10d-431d-ba53-cc4a2bd03a96 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:12.038013 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7fd20b3f-bd52-4f00-88a7-dc1b00c8aca4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:12.048211 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7fd20b3f-bd52-4f00-88a7-dc1b00c8aca4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.222171 May 19 15:06:12.051320 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 53/104] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:11 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:12.373990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fe2e3f9f-1012-47d6-b118-70840b318cd3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:12.375064 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fe2e3f9f-1012-47d6-b118-70840b318cd3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:12.383301 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fe2e3f9f-1012-47d6-b118-70840b318cd3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:12.385560 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fe2e3f9f-1012-47d6-b118-70840b318cd3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:12.392364 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fe2e3f9f-1012-47d6-b118-70840b318cd3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:12.392968 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fe2e3f9f-1012-47d6-b118-70840b318cd3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:12.439664 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-12cbedff-b10d-431d-ba53-cc4a2bd03a96 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:12.450098 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-12cbedff-b10d-431d-ba53-cc4a2bd03a96 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1367 microversion: 2.1 time: 0.470279 May 19 15:06:12.451443 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 52/105] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:11 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:12.824617 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fe2e3f9f-1012-47d6-b118-70840b318cd3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:12.837466 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:12.856206 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fe2e3f9f-1012-47d6-b118-70840b318cd3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:12.860280 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fe2e3f9f-1012-47d6-b118-70840b318cd3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:12.862440 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fe2e3f9f-1012-47d6-b118-70840b318cd3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1407 microversion: 2.20 time: 0.493019 May 19 15:06:12.863802 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 54/106] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:06:12 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:06:13.065795 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ea724939-1ca9-4c54-933b-d5b111255424 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:13.066577 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ea724939-1ca9-4c54-933b-d5b111255424 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:13.073911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ea724939-1ca9-4c54-933b-d5b111255424 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:13.074620 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ea724939-1ca9-4c54-933b-d5b111255424 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:13.075621 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ea724939-1ca9-4c54-933b-d5b111255424 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:13.076338 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ea724939-1ca9-4c54-933b-d5b111255424 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:13.341588 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ea724939-1ca9-4c54-933b-d5b111255424 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:13.357114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ea724939-1ca9-4c54-933b-d5b111255424 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.295184 May 19 15:06:13.358474 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 53/107] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:13 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:13.475795 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6623c99a-c1b0-4572-8da0-cb68357637a0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:13.477209 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6623c99a-c1b0-4572-8da0-cb68357637a0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:13.485539 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6623c99a-c1b0-4572-8da0-cb68357637a0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:13.486781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6623c99a-c1b0-4572-8da0-cb68357637a0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:13.487781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6623c99a-c1b0-4572-8da0-cb68357637a0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:13.488405 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6623c99a-c1b0-4572-8da0-cb68357637a0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:13.680634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6623c99a-c1b0-4572-8da0-cb68357637a0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:13.692886 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6623c99a-c1b0-4572-8da0-cb68357637a0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1367 microversion: 2.1 time: 0.227502 May 19 15:06:13.694009 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 55/108] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:13 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:13.882034 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-10a9f3b0-2ff0-4a89-8437-c8f7d9a0a314 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:13.883227 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-10a9f3b0-2ff0-4a89-8437-c8f7d9a0a314 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:13.886989 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=10 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:13.900549 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-10a9f3b0-2ff0-4a89-8437-c8f7d9a0a314 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:13.904735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-10a9f3b0-2ff0-4a89-8437-c8f7d9a0a314 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:13.905564 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-10a9f3b0-2ff0-4a89-8437-c8f7d9a0a314 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:13.908274 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-10a9f3b0-2ff0-4a89-8437-c8f7d9a0a314 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:14.144932 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-10a9f3b0-2ff0-4a89-8437-c8f7d9a0a314 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:14.156930 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-10a9f3b0-2ff0-4a89-8437-c8f7d9a0a314 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:14.159177 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-10a9f3b0-2ff0-4a89-8437-c8f7d9a0a314 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:14.160934 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-10a9f3b0-2ff0-4a89-8437-c8f7d9a0a314 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1407 microversion: 2.20 time: 0.282613 May 19 15:06:14.168528 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 54/109] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:06:13 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:06:14.375323 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7b73d1dd-eda3-4362-9128-0f1fc407b1b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:14.375978 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7b73d1dd-eda3-4362-9128-0f1fc407b1b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:14.383633 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=4 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:14.385858 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b73d1dd-eda3-4362-9128-0f1fc407b1b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:14.386517 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b73d1dd-eda3-4362-9128-0f1fc407b1b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:14.387523 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b73d1dd-eda3-4362-9128-0f1fc407b1b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:14.388125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b73d1dd-eda3-4362-9128-0f1fc407b1b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:14.603603 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7b73d1dd-eda3-4362-9128-0f1fc407b1b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:14.613391 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7b73d1dd-eda3-4362-9128-0f1fc407b1b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.242207 May 19 15:06:14.614116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 56/110] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:14 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:14.711750 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-2e987429-8d49-4876-9996-b5832395e22c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:14.713476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-2e987429-8d49-4876-9996-b5832395e22c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:14.725095 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2e987429-8d49-4876-9996-b5832395e22c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:14.732834 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2e987429-8d49-4876-9996-b5832395e22c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:14.733920 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2e987429-8d49-4876-9996-b5832395e22c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:14.734563 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2e987429-8d49-4876-9996-b5832395e22c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:14.902803 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-2e987429-8d49-4876-9996-b5832395e22c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:14.914108 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-2e987429-8d49-4876-9996-b5832395e22c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1557 microversion: 2.1 time: 0.207324 May 19 15:06:14.914976 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 55/111] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:14 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1557 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:14.935327 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e5bba320-ca91-47e6-8e19-a6d5006a26cb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:14.935978 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e5bba320-ca91-47e6-8e19-a6d5006a26cb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:14.947268 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e5bba320-ca91-47e6-8e19-a6d5006a26cb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:14.948244 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e5bba320-ca91-47e6-8e19-a6d5006a26cb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:14.949462 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e5bba320-ca91-47e6-8e19-a6d5006a26cb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:14.950742 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e5bba320-ca91-47e6-8e19-a6d5006a26cb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:15.056033 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e5bba320-ca91-47e6-8e19-a6d5006a26cb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125252 May 19 15:06:15.056623 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 57/112] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 15:06:14 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:06:15.183674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4ae76456-2b95-44a5-a90d-9826f187ebf6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:15.184368 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4ae76456-2b95-44a5-a90d-9826f187ebf6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:15.195438 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4ae76456-2b95-44a5-a90d-9826f187ebf6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:15.196906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4ae76456-2b95-44a5-a90d-9826f187ebf6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:15.198690 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4ae76456-2b95-44a5-a90d-9826f187ebf6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:15.201016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4ae76456-2b95-44a5-a90d-9826f187ebf6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:15.398697 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4ae76456-2b95-44a5-a90d-9826f187ebf6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:15.413561 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4ae76456-2b95-44a5-a90d-9826f187ebf6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:15.421454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4ae76456-2b95-44a5-a90d-9826f187ebf6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:15.423980 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4ae76456-2b95-44a5-a90d-9826f187ebf6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1407 microversion: 2.20 time: 0.248111 May 19 15:06:15.437421 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 56/113] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:06:15 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:06:15.630105 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7b9280fc-4804-4930-b365-a77d8cfcb5eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:15.632016 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7b9280fc-4804-4930-b365-a77d8cfcb5eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:15.644254 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b9280fc-4804-4930-b365-a77d8cfcb5eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:15.647468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b9280fc-4804-4930-b365-a77d8cfcb5eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:15.648317 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b9280fc-4804-4930-b365-a77d8cfcb5eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:15.648771 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7b9280fc-4804-4930-b365-a77d8cfcb5eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:15.845847 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7b9280fc-4804-4930-b365-a77d8cfcb5eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:15.855523 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7b9280fc-4804-4930-b365-a77d8cfcb5eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.228601 May 19 15:06:15.856839 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 58/114] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:15 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:16.385565 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-243dbcca-7ed8-4457-99a9-35ad1be1d2b9 req-8b1202bb-9a80-4a53-93a0-db478a2645f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6324753a-5912-42c2-a1f4-0bc631bea605", "name": "network-vif-plugged", "status": "completed", "tag": "3beaa750-59c9-4ce6-b188-390d70f3fb7a"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:06:16.403639 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-243dbcca-7ed8-4457-99a9-35ad1be1d2b9 req-8b1202bb-9a80-4a53-93a0-db478a2645f3 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:16.404140 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-243dbcca-7ed8-4457-99a9-35ad1be1d2b9 req-8b1202bb-9a80-4a53-93a0-db478a2645f3 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:16.430006 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-243dbcca-7ed8-4457-99a9-35ad1be1d2b9 req-8b1202bb-9a80-4a53-93a0-db478a2645f3 service nova] Creating event network-vif-plugged:3beaa750-59c9-4ce6-b188-390d70f3fb7a for instance 6324753a-5912-42c2-a1f4-0bc631bea605 on hv-cinder-82549 May 19 15:06:16.443070 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c9ea24c9-7575-4956-b524-59d403556693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:16.444349 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c9ea24c9-7575-4956-b524-59d403556693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:16.455032 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c9ea24c9-7575-4956-b524-59d403556693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:16.455512 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c9ea24c9-7575-4956-b524-59d403556693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:16.460984 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-243dbcca-7ed8-4457-99a9-35ad1be1d2b9 req-8b1202bb-9a80-4a53-93a0-db478a2645f3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080508 May 19 15:06:16.461860 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c9ea24c9-7575-4956-b524-59d403556693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:16.462396 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c9ea24c9-7575-4956-b524-59d403556693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:16.467303 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 57/115] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:06:16.629989 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c9ea24c9-7575-4956-b524-59d403556693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:16.640364 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c9ea24c9-7575-4956-b524-59d403556693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:16.641873 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c9ea24c9-7575-4956-b524-59d403556693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:16.642989 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c9ea24c9-7575-4956-b524-59d403556693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1407 microversion: 2.20 time: 0.203733 May 19 15:06:16.651523 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 59/116] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:06:16 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:06:16.730631 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-40b8ff52-836f-4925-9969-76d13a5d1e39 req-46f2885b-1308-43ea-9b2f-f78f6cf99e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3", "tag": "99e00ce6-f671-4c78-ab3b-e03e6a5532ed"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:06:16.741397 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-40b8ff52-836f-4925-9969-76d13a5d1e39 req-46f2885b-1308-43ea-9b2f-f78f6cf99e98 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:16.742054 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-40b8ff52-836f-4925-9969-76d13a5d1e39 req-46f2885b-1308-43ea-9b2f-f78f6cf99e98 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:16.754578 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-40b8ff52-836f-4925-9969-76d13a5d1e39 req-46f2885b-1308-43ea-9b2f-f78f6cf99e98 service nova] Creating event network-changed:99e00ce6-f671-4c78-ab3b-e03e6a5532ed for instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 on hv-cinder-82549 May 19 15:06:16.760123 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-40b8ff52-836f-4925-9969-76d13a5d1e39 req-46f2885b-1308-43ea-9b2f-f78f6cf99e98 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033847 May 19 15:06:16.761193 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 58/117] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:06:16.875217 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3d4ecfbd-5b6a-4350-abf1-c5f68ed2a8d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:16.875843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3d4ecfbd-5b6a-4350-abf1-c5f68ed2a8d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:16.884848 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3d4ecfbd-5b6a-4350-abf1-c5f68ed2a8d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:16.886426 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3d4ecfbd-5b6a-4350-abf1-c5f68ed2a8d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:16.888215 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3d4ecfbd-5b6a-4350-abf1-c5f68ed2a8d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:16.888918 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3d4ecfbd-5b6a-4350-abf1-c5f68ed2a8d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:17.085178 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3d4ecfbd-5b6a-4350-abf1-c5f68ed2a8d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:17.101369 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3d4ecfbd-5b6a-4350-abf1-c5f68ed2a8d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.223179 May 19 15:06:17.104113 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 60/118] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:16 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:17.661981 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-55d35d61-a967-4515-bb87-eea2b588abd6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:17.663583 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-55d35d61-a967-4515-bb87-eea2b588abd6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:17.671785 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-55d35d61-a967-4515-bb87-eea2b588abd6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:17.672440 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-55d35d61-a967-4515-bb87-eea2b588abd6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:17.673681 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-55d35d61-a967-4515-bb87-eea2b588abd6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:17.674266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-55d35d61-a967-4515-bb87-eea2b588abd6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:17.840887 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-55d35d61-a967-4515-bb87-eea2b588abd6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:17.849712 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-55d35d61-a967-4515-bb87-eea2b588abd6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:17.851589 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-55d35d61-a967-4515-bb87-eea2b588abd6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:17.852756 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-55d35d61-a967-4515-bb87-eea2b588abd6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1407 microversion: 2.20 time: 0.195920 May 19 15:06:17.853483 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 59/119] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:06:17 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:06:18.121389 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dc01a890-9906-4d5b-813e-1fc7d1cbfc3a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:18.123190 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-dc01a890-9906-4d5b-813e-1fc7d1cbfc3a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:18.137312 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc01a890-9906-4d5b-813e-1fc7d1cbfc3a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:18.137887 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc01a890-9906-4d5b-813e-1fc7d1cbfc3a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:18.139681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc01a890-9906-4d5b-813e-1fc7d1cbfc3a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:18.140994 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc01a890-9906-4d5b-813e-1fc7d1cbfc3a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:18.317280 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dc01a890-9906-4d5b-813e-1fc7d1cbfc3a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:18.326637 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-dc01a890-9906-4d5b-813e-1fc7d1cbfc3a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.209873 May 19 15:06:18.337389 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 61/120] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:18 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:18.872462 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ea9cbdf5-e499-49fe-97c7-7013cd5db4d8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:18.873621 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ea9cbdf5-e499-49fe-97c7-7013cd5db4d8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:18.883006 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ea9cbdf5-e499-49fe-97c7-7013cd5db4d8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:18.883554 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ea9cbdf5-e499-49fe-97c7-7013cd5db4d8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:18.884340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ea9cbdf5-e499-49fe-97c7-7013cd5db4d8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:18.884782 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ea9cbdf5-e499-49fe-97c7-7013cd5db4d8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:19.048373 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ea9cbdf5-e499-49fe-97c7-7013cd5db4d8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:19.061168 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ea9cbdf5-e499-49fe-97c7-7013cd5db4d8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:19.063590 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ea9cbdf5-e499-49fe-97c7-7013cd5db4d8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:19.064996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ea9cbdf5-e499-49fe-97c7-7013cd5db4d8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1407 microversion: 2.20 time: 0.198179 May 19 15:06:19.066021 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 60/121] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:06:18 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:06:19.348928 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1aa4867b-b864-41dd-8481-66fb9d13f002 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:19.348928 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1aa4867b-b864-41dd-8481-66fb9d13f002 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:19.354123 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1aa4867b-b864-41dd-8481-66fb9d13f002 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:19.354587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1aa4867b-b864-41dd-8481-66fb9d13f002 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:19.355479 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1aa4867b-b864-41dd-8481-66fb9d13f002 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:19.355932 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1aa4867b-b864-41dd-8481-66fb9d13f002 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:19.518794 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1aa4867b-b864-41dd-8481-66fb9d13f002 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:19.526527 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1aa4867b-b864-41dd-8481-66fb9d13f002 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.184991 May 19 15:06:19.528520 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 62/122] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:19 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:19.765372 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b2d6f416-c493-48b0-af3a-a4a8e7b5154f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:19.766005 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b2d6f416-c493-48b0-af3a-a4a8e7b5154f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:19.774441 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b2d6f416-c493-48b0-af3a-a4a8e7b5154f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:19.775831 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b2d6f416-c493-48b0-af3a-a4a8e7b5154f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:19.779707 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b2d6f416-c493-48b0-af3a-a4a8e7b5154f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:19.780418 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b2d6f416-c493-48b0-af3a-a4a8e7b5154f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:19.815467 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b2d6f416-c493-48b0-af3a-a4a8e7b5154f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Going to try to terminate instance {{(pid=117445) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:06:19.960377 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-b2d6f416-c493-48b0-af3a-a4a8e7b5154f tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "DELETE /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 204 len: 0 microversion: 2.1 time: 0.198697 May 19 15:06:19.963372 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 61/123] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:06:19 2022] DELETE /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:06:19.972059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-777b757f-2e4d-4e8a-921e-350324b0c661 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:19.972760 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-777b757f-2e4d-4e8a-921e-350324b0c661 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:19.987759 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-777b757f-2e4d-4e8a-921e-350324b0c661 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:19.988417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-777b757f-2e4d-4e8a-921e-350324b0c661 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:19.989678 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-777b757f-2e4d-4e8a-921e-350324b0c661 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:19.991120 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-777b757f-2e4d-4e8a-921e-350324b0c661 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:20.086618 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-5af5c61d-0b95-44e0-a9b3-859e265bc693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:20.087352 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-5af5c61d-0b95-44e0-a9b3-859e265bc693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:20.097154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5af5c61d-0b95-44e0-a9b3-859e265bc693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:20.097751 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5af5c61d-0b95-44e0-a9b3-859e265bc693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:20.098552 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5af5c61d-0b95-44e0-a9b3-859e265bc693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:20.099037 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5af5c61d-0b95-44e0-a9b3-859e265bc693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:20.234329 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-777b757f-2e4d-4e8a-921e-350324b0c661 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:20.243637 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-777b757f-2e4d-4e8a-921e-350324b0c661 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1554 microversion: 2.1 time: 0.276201 May 19 15:06:20.252807 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 63/124] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:19 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1554 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:20.362183 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5af5c61d-0b95-44e0-a9b3-859e265bc693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:20.374216 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5af5c61d-0b95-44e0-a9b3-859e265bc693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:20.376023 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5af5c61d-0b95-44e0-a9b3-859e265bc693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:20.378471 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-5af5c61d-0b95-44e0-a9b3-859e265bc693 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1407 microversion: 2.20 time: 0.297649 May 19 15:06:20.379242 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 62/125] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:06:20 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:06:20.543457 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ed5ce0c4-c6ac-41b3-8bec-70ab1845fb14 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:20.544121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ed5ce0c4-c6ac-41b3-8bec-70ab1845fb14 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:20.550393 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ed5ce0c4-c6ac-41b3-8bec-70ab1845fb14 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:20.550857 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ed5ce0c4-c6ac-41b3-8bec-70ab1845fb14 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:20.551656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ed5ce0c4-c6ac-41b3-8bec-70ab1845fb14 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:20.552117 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ed5ce0c4-c6ac-41b3-8bec-70ab1845fb14 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:20.692681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ed5ce0c4-c6ac-41b3-8bec-70ab1845fb14 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:20.701020 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ed5ce0c4-c6ac-41b3-8bec-70ab1845fb14 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.161453 May 19 15:06:20.701590 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 64/126] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:20 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:21.262049 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-5984a468-2759-4862-9b8e-3548d6c44452 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:21.262795 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-5984a468-2759-4862-9b8e-3548d6c44452 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:21.271039 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5984a468-2759-4862-9b8e-3548d6c44452 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:21.271536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5984a468-2759-4862-9b8e-3548d6c44452 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:21.272523 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5984a468-2759-4862-9b8e-3548d6c44452 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:21.273090 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5984a468-2759-4862-9b8e-3548d6c44452 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:21.403108 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-72ddc291-612a-42de-9d51-c5e71e6401a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:21.403986 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-72ddc291-612a-42de-9d51-c5e71e6401a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:21.414659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72ddc291-612a-42de-9d51-c5e71e6401a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:21.415126 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72ddc291-612a-42de-9d51-c5e71e6401a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:21.417958 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72ddc291-612a-42de-9d51-c5e71e6401a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:21.418422 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-72ddc291-612a-42de-9d51-c5e71e6401a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:21.451278 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5984a468-2759-4862-9b8e-3548d6c44452 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:21.461349 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-5984a468-2759-4862-9b8e-3548d6c44452 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1554 microversion: 2.1 time: 0.202953 May 19 15:06:21.464037 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 63/127] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:21 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1554 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:21.622177 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-72ddc291-612a-42de-9d51-c5e71e6401a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:21.649956 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-72ddc291-612a-42de-9d51-c5e71e6401a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:21.659979 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-72ddc291-612a-42de-9d51-c5e71e6401a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:21.664006 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-72ddc291-612a-42de-9d51-c5e71e6401a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1407 microversion: 2.20 time: 0.267678 May 19 15:06:21.666455 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 65/128] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:06:21 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:06:21.718820 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-0c4c2bd8-6cf2-4478-8fb8-4dd776838238 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:21.719595 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-0c4c2bd8-6cf2-4478-8fb8-4dd776838238 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:21.731163 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0c4c2bd8-6cf2-4478-8fb8-4dd776838238 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:21.733756 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0c4c2bd8-6cf2-4478-8fb8-4dd776838238 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:21.736129 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0c4c2bd8-6cf2-4478-8fb8-4dd776838238 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:21.736841 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0c4c2bd8-6cf2-4478-8fb8-4dd776838238 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:21.938022 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-0c4c2bd8-6cf2-4478-8fb8-4dd776838238 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:21.947628 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-0c4c2bd8-6cf2-4478-8fb8-4dd776838238 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.233057 May 19 15:06:21.948682 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 64/129] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:21 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:22.480250 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5d03f24a-48f0-4bc7-b87c-63e403ad88fa tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:22.480906 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5d03f24a-48f0-4bc7-b87c-63e403ad88fa tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:22.487769 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5d03f24a-48f0-4bc7-b87c-63e403ad88fa tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:22.488339 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5d03f24a-48f0-4bc7-b87c-63e403ad88fa tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:22.489283 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5d03f24a-48f0-4bc7-b87c-63e403ad88fa tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:22.489909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5d03f24a-48f0-4bc7-b87c-63e403ad88fa tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:22.654262 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5d03f24a-48f0-4bc7-b87c-63e403ad88fa tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:22.664216 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5d03f24a-48f0-4bc7-b87c-63e403ad88fa tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1554 microversion: 2.1 time: 0.187619 May 19 15:06:22.664852 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 66/130] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:22 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:22.687901 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-803f3bd6-a5b1-4725-872e-9b2fcb1b0490 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:22.689424 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-803f3bd6-a5b1-4725-872e-9b2fcb1b0490 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:22.698652 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-803f3bd6-a5b1-4725-872e-9b2fcb1b0490 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:22.699440 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-803f3bd6-a5b1-4725-872e-9b2fcb1b0490 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:22.700428 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-803f3bd6-a5b1-4725-872e-9b2fcb1b0490 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:22.701049 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-803f3bd6-a5b1-4725-872e-9b2fcb1b0490 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:22.873497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-803f3bd6-a5b1-4725-872e-9b2fcb1b0490 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:22.899119 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-803f3bd6-a5b1-4725-872e-9b2fcb1b0490 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:22.900763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-803f3bd6-a5b1-4725-872e-9b2fcb1b0490 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:22.901968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-803f3bd6-a5b1-4725-872e-9b2fcb1b0490 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1599 microversion: 2.20 time: 0.222085 May 19 15:06:22.902810 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 65/131] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:06:22 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:06:22.922344 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9294f95e-a1d5-4cd5-8e7f-a1f4db232ea5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:22.923418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9294f95e-a1d5-4cd5-8e7f-a1f4db232ea5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:22.930904 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9294f95e-a1d5-4cd5-8e7f-a1f4db232ea5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:22.932053 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9294f95e-a1d5-4cd5-8e7f-a1f4db232ea5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:22.933128 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9294f95e-a1d5-4cd5-8e7f-a1f4db232ea5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:22.933927 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9294f95e-a1d5-4cd5-8e7f-a1f4db232ea5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:22.966316 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-46cdfeef-8abb-4698-8880-2bd2723ab38d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:22.967118 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-46cdfeef-8abb-4698-8880-2bd2723ab38d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:22.983822 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-46cdfeef-8abb-4698-8880-2bd2723ab38d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:22.985653 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-46cdfeef-8abb-4698-8880-2bd2723ab38d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:22.986687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-46cdfeef-8abb-4698-8880-2bd2723ab38d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:22.989698 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-46cdfeef-8abb-4698-8880-2bd2723ab38d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:23.149721 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9294f95e-a1d5-4cd5-8e7f-a1f4db232ea5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.233471 May 19 15:06:23.158837 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 67/132] 10.222.0.24 () {60 vars in 1315 bytes} [Thu May 19 15:06:22 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/os-interface => generated 285 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 15:06:23.197678 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-46cdfeef-8abb-4698-8880-2bd2723ab38d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:23.200233 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:23.208483 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-46cdfeef-8abb-4698-8880-2bd2723ab38d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.246965 May 19 15:06:23.212160 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 66/133] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:22 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:23.683864 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cc3dd9a5-208f-4938-962e-c5dddc7773bb tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:23.687001 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cc3dd9a5-208f-4938-962e-c5dddc7773bb tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:23.696794 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc3dd9a5-208f-4938-962e-c5dddc7773bb tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:23.698344 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc3dd9a5-208f-4938-962e-c5dddc7773bb tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:23.699666 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc3dd9a5-208f-4938-962e-c5dddc7773bb tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:23.700247 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc3dd9a5-208f-4938-962e-c5dddc7773bb tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:23.808925 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cc3dd9a5-208f-4938-962e-c5dddc7773bb tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:23.823262 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cc3dd9a5-208f-4938-962e-c5dddc7773bb tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1512 microversion: 2.1 time: 0.145215 May 19 15:06:23.834748 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 68/134] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:23 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:23.839035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-de43aebb-2db0-4f10-b51b-7a7046bdf1b3 req-55219106-4755-4ece-8670-71fe41439e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d2649c-80e3-422b-9e2c-e0e946f95f17", "name": "network-vif-deleted", "tag": "cd914d91-3336-4816-af6e-7033c8452477"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:06:23.850012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-de43aebb-2db0-4f10-b51b-7a7046bdf1b3 req-55219106-4755-4ece-8670-71fe41439e22 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:23.850741 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-de43aebb-2db0-4f10-b51b-7a7046bdf1b3 req-55219106-4755-4ece-8670-71fe41439e22 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:23.896431 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-de43aebb-2db0-4f10-b51b-7a7046bdf1b3 req-55219106-4755-4ece-8670-71fe41439e22 service nova] Creating event network-vif-deleted:cd914d91-3336-4816-af6e-7033c8452477 for instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 on hv-cinder-82549 May 19 15:06:23.902745 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-de43aebb-2db0-4f10-b51b-7a7046bdf1b3 req-55219106-4755-4ece-8670-71fe41439e22 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067104 May 19 15:06:23.904157 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 67/135] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:06:24.227801 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-395e0fe7-5b2b-42c4-8920-0f44d04d9f1e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:24.228418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-395e0fe7-5b2b-42c4-8920-0f44d04d9f1e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:24.240083 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-395e0fe7-5b2b-42c4-8920-0f44d04d9f1e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:24.240670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-395e0fe7-5b2b-42c4-8920-0f44d04d9f1e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:24.241468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-395e0fe7-5b2b-42c4-8920-0f44d04d9f1e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:24.241989 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-395e0fe7-5b2b-42c4-8920-0f44d04d9f1e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:24.254367 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:24.479562 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-395e0fe7-5b2b-42c4-8920-0f44d04d9f1e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:24.491804 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-395e0fe7-5b2b-42c4-8920-0f44d04d9f1e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.265044 May 19 15:06:24.492964 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 69/136] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:24 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:24.842703 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b9c33f26-e444-4b70-9911-7eff84a66473 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:24.844083 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b9c33f26-e444-4b70-9911-7eff84a66473 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:24.862799 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b9c33f26-e444-4b70-9911-7eff84a66473 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:24.863592 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b9c33f26-e444-4b70-9911-7eff84a66473 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:24.864430 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b9c33f26-e444-4b70-9911-7eff84a66473 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:24.864906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b9c33f26-e444-4b70-9911-7eff84a66473 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:24.978367 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b9c33f26-e444-4b70-9911-7eff84a66473 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:24.981065 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b9c33f26-e444-4b70-9911-7eff84a66473 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:24.983558 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-b9c33f26-e444-4b70-9911-7eff84a66473 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lazy-loading 'fault' on Instance uuid 62d2649c-80e3-422b-9e2c-e0e946f95f17 {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:06:25.087966 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-b9c33f26-e444-4b70-9911-7eff84a66473 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b06fc42235a4ea08cd81b2bf6b4a4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f393107cd16496f85de03046f03c461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:25.097403 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-b9c33f26-e444-4b70-9911-7eff84a66473 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 200 len: 1304 microversion: 2.1 time: 0.259382 May 19 15:06:25.098423 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 68/137] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:24 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 1304 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:25.514938 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cd49b077-9876-42de-b6c4-c0c3d9e9268f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:25.516373 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cd49b077-9876-42de-b6c4-c0c3d9e9268f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:25.525821 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cd49b077-9876-42de-b6c4-c0c3d9e9268f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:25.526635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cd49b077-9876-42de-b6c4-c0c3d9e9268f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:25.527719 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cd49b077-9876-42de-b6c4-c0c3d9e9268f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:25.528531 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cd49b077-9876-42de-b6c4-c0c3d9e9268f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:25.720966 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cd49b077-9876-42de-b6c4-c0c3d9e9268f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:25.732621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cd49b077-9876-42de-b6c4-c0c3d9e9268f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.225137 May 19 15:06:25.733521 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 70/138] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:25 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:25.921681 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-053726b6-381c-4eab-a433-5df150b5fadc req-4200e7d1-bc84-424e-8839-2f1b7c868c91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6324753a-5912-42c2-a1f4-0bc631bea605", "tag": "3beaa750-59c9-4ce6-b188-390d70f3fb7a"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:06:25.931367 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-053726b6-381c-4eab-a433-5df150b5fadc req-4200e7d1-bc84-424e-8839-2f1b7c868c91 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:25.931814 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-053726b6-381c-4eab-a433-5df150b5fadc req-4200e7d1-bc84-424e-8839-2f1b7c868c91 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:25.943579 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-053726b6-381c-4eab-a433-5df150b5fadc req-4200e7d1-bc84-424e-8839-2f1b7c868c91 service nova] Creating event network-changed:3beaa750-59c9-4ce6-b188-390d70f3fb7a for instance 6324753a-5912-42c2-a1f4-0bc631bea605 on hv-cinder-82549 May 19 15:06:25.948991 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-053726b6-381c-4eab-a433-5df150b5fadc req-4200e7d1-bc84-424e-8839-2f1b7c868c91 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031112 May 19 15:06:25.949968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 69/139] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:06:26.117324 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dfd8a712-446d-47ce-abe9-8a8725ccedf1 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:26.118032 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-dfd8a712-446d-47ce-abe9-8a8725ccedf1 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:26.139372 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dfd8a712-446d-47ce-abe9-8a8725ccedf1 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:26.139823 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dfd8a712-446d-47ce-abe9-8a8725ccedf1 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:26.141027 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dfd8a712-446d-47ce-abe9-8a8725ccedf1 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:26.141470 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dfd8a712-446d-47ce-abe9-8a8725ccedf1 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:26.182866 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-dfd8a712-446d-47ce-abe9-8a8725ccedf1 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] HTTP exception thrown: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dfd8a712-446d-47ce-abe9-8a8725ccedf1 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Request method failure captured: May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 HTTP/1.1 May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihly4X783t6fecXmh6NlD_U6ArV_igF3YJ4I0t2aiJiYBY0P5zmO6oBQRmV0cg5sfDNpDmY1wym2Xvty8pq5uLsIPXVJ-DO3HoDzhUucTHyu9-GTi3kaVm64BpWYMpUMuXO5XO7eSgOHfsvrwcmaZZwbMHgrWilxF8EpVNZZCIo3DRYQ May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 4f393107cd16496f85de03046f03c461 May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-DeleteServersTestJSON-1752519224 May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:06:26.194463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:06:26.196052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4f393107cd16496f85de03046f03c461", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4f393107cd16496f85de03046f03c461"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4f393107cd16496f85de03046f03c461"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4f393107cd16496f85de03046f03c461"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:06:26.196052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-DeleteServersTestJSON-1752519224 May 19 15:06:26.196052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 4f393107cd16496f85de03046f03c461 May 19 15:06:26.196052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-DeleteServersTestJSON-1752519224 May 19 15:06:26.196052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-DeleteServersTestJSON-1752519224-project May 19 15:06:26.196052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:06:26.196052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:06:26.196052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: 8b06fc42235a4ea08cd81b2bf6b4a4cb May 19 15:06:26.196052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-DeleteServersTestJSON-1752519224-project May 19 15:06:26.196052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:06:26.196052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:26.196052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': '62d2649c-80e3-422b-9e2c-e0e946f95f17'} May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:06:26.196909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:26.198282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:06:26.200221 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dfd8a712-446d-47ce-abe9-8a8725ccedf1 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Returning 404 to user: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:06:26.202625 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-dfd8a712-446d-47ce-abe9-8a8725ccedf1 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 404 len: 111 microversion: 2.1 time: 0.092478 May 19 15:06:26.207286 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 71/140] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:26 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:06:26.495366 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a87ab43c-01cf-45e7-bc2d-964970ccc003 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:26.496912 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-a87ab43c-01cf-45e7-bc2d-964970ccc003 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:26.515361 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a87ab43c-01cf-45e7-bc2d-964970ccc003 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:26.516363 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a87ab43c-01cf-45e7-bc2d-964970ccc003 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:26.517351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a87ab43c-01cf-45e7-bc2d-964970ccc003 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:26.517978 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a87ab43c-01cf-45e7-bc2d-964970ccc003 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:26.539309 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-a87ab43c-01cf-45e7-bc2d-964970ccc003 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] HTTP exception thrown: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a87ab43c-01cf-45e7-bc2d-964970ccc003 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Request method failure captured: May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17/os-volume_attachments HTTP/1.1 May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihly4X783t6fecXmh6NlD_U6ArV_igF3YJ4I0t2aiJiYBY0P5zmO6oBQRmV0cg5sfDNpDmY1wym2Xvty8pq5uLsIPXVJ-DO3HoDzhUucTHyu9-GTi3kaVm64BpWYMpUMuXO5XO7eSgOHfsvrwcmaZZwbMHgrWilxF8EpVNZZCIo3DRYQ May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 4f393107cd16496f85de03046f03c461 May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-DeleteServersTestJSON-1752519224 May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:06:26.543541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:06:26.544755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4f393107cd16496f85de03046f03c461", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4f393107cd16496f85de03046f03c461"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4f393107cd16496f85de03046f03c461"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4f393107cd16496f85de03046f03c461"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:06:26.544755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-DeleteServersTestJSON-1752519224 May 19 15:06:26.544755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 4f393107cd16496f85de03046f03c461 May 19 15:06:26.544755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-DeleteServersTestJSON-1752519224 May 19 15:06:26.544755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-DeleteServersTestJSON-1752519224-project May 19 15:06:26.544755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:06:26.544755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:06:26.544755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 8b06fc42235a4ea08cd81b2bf6b4a4cb May 19 15:06:26.544755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-DeleteServersTestJSON-1752519224-project May 19 15:06:26.544755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:06:26.544755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:26.544755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'server_id': '62d2649c-80e3-422b-9e2c-e0e946f95f17'} May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:06:26.547587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:26.548821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:06:26.549865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a87ab43c-01cf-45e7-bc2d-964970ccc003 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Returning 404 to user: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:06:26.549865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-a87ab43c-01cf-45e7-bc2d-964970ccc003 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.054273 May 19 15:06:26.549865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 70/141] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:06:26 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:06:26.753437 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-65d4eca2-e740-41de-87b7-0dd1843bebca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:26.754188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-65d4eca2-e740-41de-87b7-0dd1843bebca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:26.764824 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-65d4eca2-e740-41de-87b7-0dd1843bebca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:26.766053 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-65d4eca2-e740-41de-87b7-0dd1843bebca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:26.767533 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-65d4eca2-e740-41de-87b7-0dd1843bebca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:26.768499 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-65d4eca2-e740-41de-87b7-0dd1843bebca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:26.960762 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-65d4eca2-e740-41de-87b7-0dd1843bebca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:26.974094 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-65d4eca2-e740-41de-87b7-0dd1843bebca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.224551 May 19 15:06:26.975748 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 72/142] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:26 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:06:27.860143 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9c475a44-d70d-48ed-adc4-f228381d615c tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:27.860745 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-9c475a44-d70d-48ed-adc4-f228381d615c tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:27.871943 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9c475a44-d70d-48ed-adc4-f228381d615c tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:27.872418 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9c475a44-d70d-48ed-adc4-f228381d615c tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:27.876086 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9c475a44-d70d-48ed-adc4-f228381d615c tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:27.876547 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9c475a44-d70d-48ed-adc4-f228381d615c tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:27.898211 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-9c475a44-d70d-48ed-adc4-f228381d615c tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] HTTP exception thrown: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9c475a44-d70d-48ed-adc4-f228381d615c tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Request method failure captured: May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: DELETE /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 HTTP/1.1 May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihly4X783t6fecXmh6NlD_U6ArV_igF3YJ4I0t2aiJiYBY0P5zmO6oBQRmV0cg5sfDNpDmY1wym2Xvty8pq5uLsIPXVJ-DO3HoDzhUucTHyu9-GTi3kaVm64BpWYMpUMuXO5XO7eSgOHfsvrwcmaZZwbMHgrWilxF8EpVNZZCIo3DRYQ May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 4f393107cd16496f85de03046f03c461 May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-DeleteServersTestJSON-1752519224 May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:06:27.906115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:06:27.907477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4f393107cd16496f85de03046f03c461", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4f393107cd16496f85de03046f03c461"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4f393107cd16496f85de03046f03c461"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4f393107cd16496f85de03046f03c461"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:06:27.907477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-DeleteServersTestJSON-1752519224 May 19 15:06:27.907477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 4f393107cd16496f85de03046f03c461 May 19 15:06:27.907477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-DeleteServersTestJSON-1752519224 May 19 15:06:27.907477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-DeleteServersTestJSON-1752519224-project May 19 15:06:27.907477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:06:27.907477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:06:27.907477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 8b06fc42235a4ea08cd81b2bf6b4a4cb May 19 15:06:27.907477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-DeleteServersTestJSON-1752519224-project May 19 15:06:27.907477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:06:27.907477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:27.907477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '62d2649c-80e3-422b-9e2c-e0e946f95f17'} May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:06:27.908180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:27.909355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:06:27.910465 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9c475a44-d70d-48ed-adc4-f228381d615c tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Returning 404 to user: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:06:27.910465 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9c475a44-d70d-48ed-adc4-f228381d615c tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "DELETE /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 404 len: 111 microversion: 2.1 time: 0.051531 May 19 15:06:27.914931 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 71/143] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:06:27 2022] DELETE /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:06:27.920850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b44cb6b6-ad18-4e72-989d-84033ebc8047 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:27.921405 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b44cb6b6-ad18-4e72-989d-84033ebc8047 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] [instance: 62d2649c-80e3-422b-9e2c-e0e946f95f17] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:27.930127 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b44cb6b6-ad18-4e72-989d-84033ebc8047 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:27.930562 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b44cb6b6-ad18-4e72-989d-84033ebc8047 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:27.931562 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b44cb6b6-ad18-4e72-989d-84033ebc8047 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:27.932158 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b44cb6b6-ad18-4e72-989d-84033ebc8047 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:27.948145 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-b44cb6b6-ad18-4e72-989d-84033ebc8047 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] HTTP exception thrown: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b44cb6b6-ad18-4e72-989d-84033ebc8047 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Request method failure captured: May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 HTTP/1.1 May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihly4X783t6fecXmh6NlD_U6ArV_igF3YJ4I0t2aiJiYBY0P5zmO6oBQRmV0cg5sfDNpDmY1wym2Xvty8pq5uLsIPXVJ-DO3HoDzhUucTHyu9-GTi3kaVm64BpWYMpUMuXO5XO7eSgOHfsvrwcmaZZwbMHgrWilxF8EpVNZZCIo3DRYQ May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 4f393107cd16496f85de03046f03c461 May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-DeleteServersTestJSON-1752519224 May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:06:27.950341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:06:27.952418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_4f393107cd16496f85de03046f03c461", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4f393107cd16496f85de03046f03c461"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/4f393107cd16496f85de03046f03c461"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/4f393107cd16496f85de03046f03c461"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:06:27.952418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-DeleteServersTestJSON-1752519224 May 19 15:06:27.952418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 4f393107cd16496f85de03046f03c461 May 19 15:06:27.952418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-DeleteServersTestJSON-1752519224 May 19 15:06:27.952418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-DeleteServersTestJSON-1752519224-project May 19 15:06:27.952418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:06:27.952418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:06:27.952418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: 8b06fc42235a4ea08cd81b2bf6b4a4cb May 19 15:06:27.952418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-DeleteServersTestJSON-1752519224-project May 19 15:06:27.952418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:06:27.952418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:27.952418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': '62d2649c-80e3-422b-9e2c-e0e946f95f17'} May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:06:27.953116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. May 19 15:06:27.954257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:06:27.955839 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b44cb6b6-ad18-4e72-989d-84033ebc8047 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] Returning 404 to user: Instance 62d2649c-80e3-422b-9e2c-e0e946f95f17 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:06:27.957602 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b44cb6b6-ad18-4e72-989d-84033ebc8047 tempest-DeleteServersTestJSON-1752519224 tempest-DeleteServersTestJSON-1752519224-project] 10.222.0.24 "GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17" status: 404 len: 111 microversion: 2.1 time: 0.041981 May 19 15:06:27.958734 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 73/144] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:27 2022] GET /compute/v2.1/servers/62d2649c-80e3-422b-9e2c-e0e946f95f17 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:06:27.993843 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-200f667d-76bf-43de-a7c8-4fc06043ba18 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:27.994472 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-200f667d-76bf-43de-a7c8-4fc06043ba18 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:28.010134 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-200f667d-76bf-43de-a7c8-4fc06043ba18 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:28.010602 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-200f667d-76bf-43de-a7c8-4fc06043ba18 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:28.012656 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-200f667d-76bf-43de-a7c8-4fc06043ba18 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:28.013120 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-200f667d-76bf-43de-a7c8-4fc06043ba18 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:28.320662 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-200f667d-76bf-43de-a7c8-4fc06043ba18 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:28.350624 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-200f667d-76bf-43de-a7c8-4fc06043ba18 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.362319 May 19 15:06:28.351768 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 72/145] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:27 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:29.369103 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a1adac23-e0ed-46a1-8626-058c249b4eac tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:29.369722 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a1adac23-e0ed-46a1-8626-058c249b4eac tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:29.373741 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:29.379509 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1adac23-e0ed-46a1-8626-058c249b4eac tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:29.380187 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1adac23-e0ed-46a1-8626-058c249b4eac tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:29.381726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1adac23-e0ed-46a1-8626-058c249b4eac tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:29.382326 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1adac23-e0ed-46a1-8626-058c249b4eac tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:29.581236 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a1adac23-e0ed-46a1-8626-058c249b4eac tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:29.591428 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a1adac23-e0ed-46a1-8626-058c249b4eac tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.224286 May 19 15:06:29.591428 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 74/146] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:29 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:30.606334 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-592f6948-f4b3-4d7d-a378-7eba63ed3093 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:30.606939 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-592f6948-f4b3-4d7d-a378-7eba63ed3093 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:30.610709 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:30.615754 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-592f6948-f4b3-4d7d-a378-7eba63ed3093 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:30.616396 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-592f6948-f4b3-4d7d-a378-7eba63ed3093 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:30.617280 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-592f6948-f4b3-4d7d-a378-7eba63ed3093 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:30.617723 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-592f6948-f4b3-4d7d-a378-7eba63ed3093 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:30.781853 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-592f6948-f4b3-4d7d-a378-7eba63ed3093 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:30.793703 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-592f6948-f4b3-4d7d-a378-7eba63ed3093 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.191682 May 19 15:06:30.794288 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 73/147] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:30 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:31.811329 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c1b8b461-03e1-45e3-aaea-62c503e59669 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:31.811950 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c1b8b461-03e1-45e3-aaea-62c503e59669 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:31.820331 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c1b8b461-03e1-45e3-aaea-62c503e59669 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:31.820999 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c1b8b461-03e1-45e3-aaea-62c503e59669 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:31.822133 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c1b8b461-03e1-45e3-aaea-62c503e59669 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:31.822730 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c1b8b461-03e1-45e3-aaea-62c503e59669 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:31.984102 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c1b8b461-03e1-45e3-aaea-62c503e59669 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:31.995152 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c1b8b461-03e1-45e3-aaea-62c503e59669 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.187602 May 19 15:06:31.996018 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 75/148] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:31 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:33.013024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-57cd746e-03f8-4b9b-85e3-26ba62ef3ac9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:33.013635 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-57cd746e-03f8-4b9b-85e3-26ba62ef3ac9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:33.022360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-57cd746e-03f8-4b9b-85e3-26ba62ef3ac9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:33.022810 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-57cd746e-03f8-4b9b-85e3-26ba62ef3ac9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:33.023605 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-57cd746e-03f8-4b9b-85e3-26ba62ef3ac9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:33.024213 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-57cd746e-03f8-4b9b-85e3-26ba62ef3ac9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:33.439497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-57cd746e-03f8-4b9b-85e3-26ba62ef3ac9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:33.470806 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-57cd746e-03f8-4b9b-85e3-26ba62ef3ac9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.460245 May 19 15:06:33.473942 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 74/149] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:33 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:34.490593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9a0819c2-656f-4781-92ae-eed6ad9d88f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:34.491407 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9a0819c2-656f-4781-92ae-eed6ad9d88f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:34.498101 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9a0819c2-656f-4781-92ae-eed6ad9d88f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:34.498559 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9a0819c2-656f-4781-92ae-eed6ad9d88f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:34.499364 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9a0819c2-656f-4781-92ae-eed6ad9d88f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:34.499806 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9a0819c2-656f-4781-92ae-eed6ad9d88f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:34.637383 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9a0819c2-656f-4781-92ae-eed6ad9d88f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:34.646497 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9a0819c2-656f-4781-92ae-eed6ad9d88f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.159683 May 19 15:06:34.647079 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 76/150] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:34 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:35.663881 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-857c34a4-b468-4dd4-ab0a-c7f146fec3c7 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:35.664618 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-857c34a4-b468-4dd4-ab0a-c7f146fec3c7 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:35.671667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-857c34a4-b468-4dd4-ab0a-c7f146fec3c7 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:35.672212 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-857c34a4-b468-4dd4-ab0a-c7f146fec3c7 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:35.673052 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-857c34a4-b468-4dd4-ab0a-c7f146fec3c7 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:35.673564 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-857c34a4-b468-4dd4-ab0a-c7f146fec3c7 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:35.806559 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-857c34a4-b468-4dd4-ab0a-c7f146fec3c7 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:35.814204 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-857c34a4-b468-4dd4-ab0a-c7f146fec3c7 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.154859 May 19 15:06:35.815122 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 75/151] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:35 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:36.831093 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2375325e-c99b-4fed-9f9b-3bce27b4fb15 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:36.831650 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2375325e-c99b-4fed-9f9b-3bce27b4fb15 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:36.838127 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2375325e-c99b-4fed-9f9b-3bce27b4fb15 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:36.838582 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2375325e-c99b-4fed-9f9b-3bce27b4fb15 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:36.839382 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2375325e-c99b-4fed-9f9b-3bce27b4fb15 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:36.839822 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2375325e-c99b-4fed-9f9b-3bce27b4fb15 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:36.965869 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2375325e-c99b-4fed-9f9b-3bce27b4fb15 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:36.973549 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2375325e-c99b-4fed-9f9b-3bce27b4fb15 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.146421 May 19 15:06:36.974115 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 77/152] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:36 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:37.989519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-8fe123ca-6205-47cf-a14b-e25f7903f43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:37.990129 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-8fe123ca-6205-47cf-a14b-e25f7903f43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:37.997022 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8fe123ca-6205-47cf-a14b-e25f7903f43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:37.997473 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8fe123ca-6205-47cf-a14b-e25f7903f43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:37.998241 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8fe123ca-6205-47cf-a14b-e25f7903f43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:37.998676 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8fe123ca-6205-47cf-a14b-e25f7903f43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:38.141582 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8fe123ca-6205-47cf-a14b-e25f7903f43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:38.150608 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-8fe123ca-6205-47cf-a14b-e25f7903f43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.164831 May 19 15:06:38.151312 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 76/153] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:37 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:39.168638 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c67da65f-106d-4755-a6b4-fe4aa7455e9b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:39.169244 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c67da65f-106d-4755-a6b4-fe4aa7455e9b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:39.175093 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c67da65f-106d-4755-a6b4-fe4aa7455e9b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:39.175570 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c67da65f-106d-4755-a6b4-fe4aa7455e9b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:39.176329 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c67da65f-106d-4755-a6b4-fe4aa7455e9b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:39.176759 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c67da65f-106d-4755-a6b4-fe4aa7455e9b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:39.311614 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c67da65f-106d-4755-a6b4-fe4aa7455e9b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:39.319319 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c67da65f-106d-4755-a6b4-fe4aa7455e9b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.154397 May 19 15:06:39.319897 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 78/154] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:39 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:40.339843 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4ff809a2-662a-4fe6-b7e9-fc594e3ae3e3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:40.339843 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4ff809a2-662a-4fe6-b7e9-fc594e3ae3e3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:40.343596 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4ff809a2-662a-4fe6-b7e9-fc594e3ae3e3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:40.344048 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4ff809a2-662a-4fe6-b7e9-fc594e3ae3e3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:40.344816 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4ff809a2-662a-4fe6-b7e9-fc594e3ae3e3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:40.345248 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4ff809a2-662a-4fe6-b7e9-fc594e3ae3e3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:40.478395 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4ff809a2-662a-4fe6-b7e9-fc594e3ae3e3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:40.486087 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4ff809a2-662a-4fe6-b7e9-fc594e3ae3e3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.153373 May 19 15:06:40.486512 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 77/155] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:40 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:41.503613 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-75ced4f2-83c9-4b2e-9a4f-fc57a7dc3446 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:41.504300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-75ced4f2-83c9-4b2e-9a4f-fc57a7dc3446 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:41.510709 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75ced4f2-83c9-4b2e-9a4f-fc57a7dc3446 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:41.511175 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75ced4f2-83c9-4b2e-9a4f-fc57a7dc3446 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:41.511967 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75ced4f2-83c9-4b2e-9a4f-fc57a7dc3446 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:41.512404 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75ced4f2-83c9-4b2e-9a4f-fc57a7dc3446 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:41.659178 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-75ced4f2-83c9-4b2e-9a4f-fc57a7dc3446 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:41.668946 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-75ced4f2-83c9-4b2e-9a4f-fc57a7dc3446 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.169181 May 19 15:06:41.669493 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 79/156] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:41 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:42.685356 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6ea86736-8172-4f78-851a-2ce1b26cb25f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:42.686001 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-6ea86736-8172-4f78-851a-2ce1b26cb25f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:42.692454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6ea86736-8172-4f78-851a-2ce1b26cb25f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:42.692904 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6ea86736-8172-4f78-851a-2ce1b26cb25f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:42.693668 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6ea86736-8172-4f78-851a-2ce1b26cb25f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:42.694108 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6ea86736-8172-4f78-851a-2ce1b26cb25f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:42.827300 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6ea86736-8172-4f78-851a-2ce1b26cb25f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:42.835793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6ea86736-8172-4f78-851a-2ce1b26cb25f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.154054 May 19 15:06:42.836630 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 78/157] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:42 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:43.853276 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e7d33205-6619-492f-adac-53087d085482 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:43.853886 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e7d33205-6619-492f-adac-53087d085482 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:43.859844 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7d33205-6619-492f-adac-53087d085482 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:43.860297 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7d33205-6619-492f-adac-53087d085482 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:43.861051 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7d33205-6619-492f-adac-53087d085482 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:43.861483 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7d33205-6619-492f-adac-53087d085482 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:43.988487 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e7d33205-6619-492f-adac-53087d085482 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:43.996129 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e7d33205-6619-492f-adac-53087d085482 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.147183 May 19 15:06:43.996716 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 80/158] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:43 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:45.012851 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a246f05f-c4c5-4d2b-b379-789cea53658a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:45.013467 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-a246f05f-c4c5-4d2b-b379-789cea53658a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:45.020002 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a246f05f-c4c5-4d2b-b379-789cea53658a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:45.020455 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a246f05f-c4c5-4d2b-b379-789cea53658a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:45.021265 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a246f05f-c4c5-4d2b-b379-789cea53658a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:45.021715 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a246f05f-c4c5-4d2b-b379-789cea53658a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:45.153576 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-a246f05f-c4c5-4d2b-b379-789cea53658a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:45.161310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-a246f05f-c4c5-4d2b-b379-789cea53658a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.152377 May 19 15:06:45.162452 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 79/159] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:45 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:46.178781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a1ea0676-94c2-42e7-b87d-29ac71e597f2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:46.179514 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a1ea0676-94c2-42e7-b87d-29ac71e597f2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:46.185711 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1ea0676-94c2-42e7-b87d-29ac71e597f2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:46.186140 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1ea0676-94c2-42e7-b87d-29ac71e597f2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:46.186882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1ea0676-94c2-42e7-b87d-29ac71e597f2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:46.187367 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1ea0676-94c2-42e7-b87d-29ac71e597f2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:46.322908 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a1ea0676-94c2-42e7-b87d-29ac71e597f2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:46.330667 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a1ea0676-94c2-42e7-b87d-29ac71e597f2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.155796 May 19 15:06:46.331266 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 81/160] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:46 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:47.347637 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f358fa94-29cd-42d4-88d1-ecf7b9d2d9be tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:47.348254 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f358fa94-29cd-42d4-88d1-ecf7b9d2d9be tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:47.355486 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f358fa94-29cd-42d4-88d1-ecf7b9d2d9be tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:47.356151 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f358fa94-29cd-42d4-88d1-ecf7b9d2d9be tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:47.356925 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f358fa94-29cd-42d4-88d1-ecf7b9d2d9be tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:47.357368 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f358fa94-29cd-42d4-88d1-ecf7b9d2d9be tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:47.484606 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f358fa94-29cd-42d4-88d1-ecf7b9d2d9be tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:47.492159 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f358fa94-29cd-42d4-88d1-ecf7b9d2d9be tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.148389 May 19 15:06:47.492737 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 80/161] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:47 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:48.509276 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-57f13a32-7948-4d46-af78-d98bac173746 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:48.509910 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-57f13a32-7948-4d46-af78-d98bac173746 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:48.516027 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-57f13a32-7948-4d46-af78-d98bac173746 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:48.516475 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-57f13a32-7948-4d46-af78-d98bac173746 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:48.517281 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-57f13a32-7948-4d46-af78-d98bac173746 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:48.517699 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-57f13a32-7948-4d46-af78-d98bac173746 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:48.655415 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-57f13a32-7948-4d46-af78-d98bac173746 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:48.664755 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-57f13a32-7948-4d46-af78-d98bac173746 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.159528 May 19 15:06:48.665330 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 82/162] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:48 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:49.688203 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-0c0061f0-67bc-4c8a-ad20-60fe775cce54 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:49.688829 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-0c0061f0-67bc-4c8a-ad20-60fe775cce54 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:49.695406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0c0061f0-67bc-4c8a-ad20-60fe775cce54 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:49.695902 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0c0061f0-67bc-4c8a-ad20-60fe775cce54 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:49.697082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0c0061f0-67bc-4c8a-ad20-60fe775cce54 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:49.697538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0c0061f0-67bc-4c8a-ad20-60fe775cce54 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:49.868791 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-0c0061f0-67bc-4c8a-ad20-60fe775cce54 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:49.882503 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-0c0061f0-67bc-4c8a-ad20-60fe775cce54 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.203331 May 19 15:06:49.882503 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 81/163] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:49 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:50.898481 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8784bf07-b026-42d2-aa42-dbf8ecb13b01 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:50.899226 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8784bf07-b026-42d2-aa42-dbf8ecb13b01 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:50.907991 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8784bf07-b026-42d2-aa42-dbf8ecb13b01 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:50.908835 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8784bf07-b026-42d2-aa42-dbf8ecb13b01 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:50.909722 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8784bf07-b026-42d2-aa42-dbf8ecb13b01 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:50.910261 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8784bf07-b026-42d2-aa42-dbf8ecb13b01 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:51.054356 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8784bf07-b026-42d2-aa42-dbf8ecb13b01 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:51.061763 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8784bf07-b026-42d2-aa42-dbf8ecb13b01 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.167321 May 19 15:06:51.062358 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 83/164] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:50 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:52.080004 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c78ee797-756e-4828-a86c-4e05cdbbb07b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:52.080852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c78ee797-756e-4828-a86c-4e05cdbbb07b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:52.087964 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c78ee797-756e-4828-a86c-4e05cdbbb07b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:52.088390 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c78ee797-756e-4828-a86c-4e05cdbbb07b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:52.089156 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c78ee797-756e-4828-a86c-4e05cdbbb07b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:52.089591 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c78ee797-756e-4828-a86c-4e05cdbbb07b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:52.218656 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c78ee797-756e-4828-a86c-4e05cdbbb07b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:52.226677 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c78ee797-756e-4828-a86c-4e05cdbbb07b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.150802 May 19 15:06:52.227261 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 82/165] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:52 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:53.244058 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4a2ecd14-49f8-4780-a953-c7e94d86a4b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:53.244670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4a2ecd14-49f8-4780-a953-c7e94d86a4b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:53.251134 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4a2ecd14-49f8-4780-a953-c7e94d86a4b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:53.251621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4a2ecd14-49f8-4780-a953-c7e94d86a4b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:53.252388 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4a2ecd14-49f8-4780-a953-c7e94d86a4b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:53.252836 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4a2ecd14-49f8-4780-a953-c7e94d86a4b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:53.401912 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4a2ecd14-49f8-4780-a953-c7e94d86a4b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:53.411324 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4a2ecd14-49f8-4780-a953-c7e94d86a4b4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1521 microversion: 2.1 time: 0.171063 May 19 15:06:53.417195 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 84/166] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:53 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:54.434614 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a6e58c24-1f5d-4c68-a541-6d56186a3ebb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:54.435319 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-a6e58c24-1f5d-4c68-a541-6d56186a3ebb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:54.443089 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a6e58c24-1f5d-4c68-a541-6d56186a3ebb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:54.443666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a6e58c24-1f5d-4c68-a541-6d56186a3ebb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:54.444474 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a6e58c24-1f5d-4c68-a541-6d56186a3ebb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:54.444906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a6e58c24-1f5d-4c68-a541-6d56186a3ebb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:54.447627 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=84 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:54.585469 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-a6e58c24-1f5d-4c68-a541-6d56186a3ebb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:54.592911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-a6e58c24-1f5d-4c68-a541-6d56186a3ebb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1501 microversion: 2.1 time: 0.162410 May 19 15:06:54.593492 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 83/167] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:54 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:06:54.608993 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-61beedfa-ba89-43a9-bf85-4f02dab5697e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:06:54.609617 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-61beedfa-ba89-43a9-bf85-4f02dab5697e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:06:54.615710 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-61beedfa-ba89-43a9-bf85-4f02dab5697e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:54.616167 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-61beedfa-ba89-43a9-bf85-4f02dab5697e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:54.616935 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-61beedfa-ba89-43a9-bf85-4f02dab5697e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:06:54.617374 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-61beedfa-ba89-43a9-bf85-4f02dab5697e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:06:54.621513 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=88 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:06:54.746937 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-61beedfa-ba89-43a9-bf85-4f02dab5697e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:06:54.754533 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-61beedfa-ba89-43a9-bf85-4f02dab5697e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1515 microversion: 2.1 time: 0.149304 May 19 15:06:54.759239 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 85/168] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:06:54 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:04.536353 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-11742c1e-2cb4-4f64-9491-bb22e1055616 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:04.538155 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-11742c1e-2cb4-4f64-9491-bb22e1055616 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:04.546881 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=21 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:04.552240 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-11742c1e-2cb4-4f64-9491-bb22e1055616 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:04.553534 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-11742c1e-2cb4-4f64-9491-bb22e1055616 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:04.555188 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-11742c1e-2cb4-4f64-9491-bb22e1055616 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:04.556465 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-11742c1e-2cb4-4f64-9491-bb22e1055616 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:04.588857 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-11742c1e-2cb4-4f64-9491-bb22e1055616 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lazy-loading 'flavor' on Instance uuid 1724bc45-95a0-405b-ac06-8e4ffe410b21 {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:07:04.734969 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-11742c1e-2cb4-4f64-9491-bb22e1055616 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "POST /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21/action" status: 200 len: 32 microversion: 2.1 time: 0.202829 May 19 15:07:04.735909 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 84/169] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 15:07:04 2022] POST /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21/action => generated 32 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 15:07:04.746027 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f3823cc6-b640-4672-b038-0631921a91dc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:04.746635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f3823cc6-b640-4672-b038-0631921a91dc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:04.749658 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=23 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:04.751249 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=5 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:04.778099 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f3823cc6-b640-4672-b038-0631921a91dc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:04.778516 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f3823cc6-b640-4672-b038-0631921a91dc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:04.779725 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f3823cc6-b640-4672-b038-0631921a91dc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:04.780162 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f3823cc6-b640-4672-b038-0631921a91dc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:04.947035 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f3823cc6-b640-4672-b038-0631921a91dc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:04.963784 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f3823cc6-b640-4672-b038-0631921a91dc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.220541 May 19 15:07:04.968336 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 86/170] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:04 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:05.985281 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-0b0a4c9d-4da9-4f29-b0bb-0c8b8641009d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:05.985923 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-0b0a4c9d-4da9-4f29-b0bb-0c8b8641009d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:05.992708 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0b0a4c9d-4da9-4f29-b0bb-0c8b8641009d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:05.993163 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0b0a4c9d-4da9-4f29-b0bb-0c8b8641009d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:05.993923 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0b0a4c9d-4da9-4f29-b0bb-0c8b8641009d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:05.994361 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0b0a4c9d-4da9-4f29-b0bb-0c8b8641009d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:06.121392 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-0b0a4c9d-4da9-4f29-b0bb-0c8b8641009d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:06.128737 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-0b0a4c9d-4da9-4f29-b0bb-0c8b8641009d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.148168 May 19 15:07:06.129314 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 85/171] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:05 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:07.145914 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a0fadfed-4498-4694-9a37-a94212e2da4e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:07.146535 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a0fadfed-4498-4694-9a37-a94212e2da4e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:07.152759 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a0fadfed-4498-4694-9a37-a94212e2da4e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:07.153015 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a0fadfed-4498-4694-9a37-a94212e2da4e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:07.153781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a0fadfed-4498-4694-9a37-a94212e2da4e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:07.154225 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a0fadfed-4498-4694-9a37-a94212e2da4e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:07.283309 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a0fadfed-4498-4694-9a37-a94212e2da4e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:07.291370 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a0fadfed-4498-4694-9a37-a94212e2da4e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.149487 May 19 15:07:07.291970 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 87/172] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:07 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:08.308801 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b618b7a5-36c9-4fe7-95ae-9af3d7b05fcb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:08.309409 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b618b7a5-36c9-4fe7-95ae-9af3d7b05fcb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:08.315997 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b618b7a5-36c9-4fe7-95ae-9af3d7b05fcb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:08.316447 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b618b7a5-36c9-4fe7-95ae-9af3d7b05fcb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:08.317676 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b618b7a5-36c9-4fe7-95ae-9af3d7b05fcb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:08.317676 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b618b7a5-36c9-4fe7-95ae-9af3d7b05fcb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:08.449382 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-b618b7a5-36c9-4fe7-95ae-9af3d7b05fcb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:08.457126 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-b618b7a5-36c9-4fe7-95ae-9af3d7b05fcb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.152141 May 19 15:07:08.457688 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 86/173] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:08 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:09.475975 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e1a4cfab-6f05-4508-814f-b7fe8bacee6c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:09.476608 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e1a4cfab-6f05-4508-814f-b7fe8bacee6c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:09.482856 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1a4cfab-6f05-4508-814f-b7fe8bacee6c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:09.483358 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1a4cfab-6f05-4508-814f-b7fe8bacee6c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:09.484138 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1a4cfab-6f05-4508-814f-b7fe8bacee6c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:09.484580 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1a4cfab-6f05-4508-814f-b7fe8bacee6c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:09.627320 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e1a4cfab-6f05-4508-814f-b7fe8bacee6c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:09.635485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e1a4cfab-6f05-4508-814f-b7fe8bacee6c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.163953 May 19 15:07:09.636062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 88/174] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:09 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:10.652257 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f88c1dce-4d71-43ef-a1b1-690f7b086bca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:10.652864 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f88c1dce-4d71-43ef-a1b1-690f7b086bca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:10.659012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f88c1dce-4d71-43ef-a1b1-690f7b086bca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:10.659504 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f88c1dce-4d71-43ef-a1b1-690f7b086bca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:10.660290 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f88c1dce-4d71-43ef-a1b1-690f7b086bca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:10.660737 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f88c1dce-4d71-43ef-a1b1-690f7b086bca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:10.791721 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f88c1dce-4d71-43ef-a1b1-690f7b086bca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:10.799248 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f88c1dce-4d71-43ef-a1b1-690f7b086bca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.150972 May 19 15:07:10.799812 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 87/175] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:10 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:11.816655 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-38dc135e-793a-4d96-99d8-73af4d063c48 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:11.817277 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-38dc135e-793a-4d96-99d8-73af4d063c48 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:11.824177 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38dc135e-793a-4d96-99d8-73af4d063c48 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:11.824611 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38dc135e-793a-4d96-99d8-73af4d063c48 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:11.825372 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38dc135e-793a-4d96-99d8-73af4d063c48 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:11.825815 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38dc135e-793a-4d96-99d8-73af4d063c48 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:11.960692 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-38dc135e-793a-4d96-99d8-73af4d063c48 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:11.969238 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-38dc135e-793a-4d96-99d8-73af4d063c48 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.156431 May 19 15:07:11.970041 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 89/176] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:11 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:12.985870 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-73326e1a-a9bd-498e-a389-fba617cdb2b9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:12.986542 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-73326e1a-a9bd-498e-a389-fba617cdb2b9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:12.994315 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-73326e1a-a9bd-498e-a389-fba617cdb2b9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:12.994851 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-73326e1a-a9bd-498e-a389-fba617cdb2b9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:12.996032 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-73326e1a-a9bd-498e-a389-fba617cdb2b9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:12.996775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-73326e1a-a9bd-498e-a389-fba617cdb2b9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:13.131858 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-73326e1a-a9bd-498e-a389-fba617cdb2b9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:13.139429 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-73326e1a-a9bd-498e-a389-fba617cdb2b9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.157257 May 19 15:07:13.139995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 88/177] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:12 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:14.158373 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-98945204-ea98-4ffa-a679-bcb46127dcf2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:14.158991 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-98945204-ea98-4ffa-a679-bcb46127dcf2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:14.165641 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98945204-ea98-4ffa-a679-bcb46127dcf2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:14.166101 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98945204-ea98-4ffa-a679-bcb46127dcf2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:14.166868 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98945204-ea98-4ffa-a679-bcb46127dcf2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:14.167343 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98945204-ea98-4ffa-a679-bcb46127dcf2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:14.293522 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-98945204-ea98-4ffa-a679-bcb46127dcf2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:14.300906 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-98945204-ea98-4ffa-a679-bcb46127dcf2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.146456 May 19 15:07:14.301476 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 90/178] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:14 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:15.317784 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4672ba07-7cc5-43c1-a3db-c34c2db632e0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:15.318395 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4672ba07-7cc5-43c1-a3db-c34c2db632e0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:15.325645 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4672ba07-7cc5-43c1-a3db-c34c2db632e0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:15.326093 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4672ba07-7cc5-43c1-a3db-c34c2db632e0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:15.326855 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4672ba07-7cc5-43c1-a3db-c34c2db632e0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:15.327314 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4672ba07-7cc5-43c1-a3db-c34c2db632e0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:15.457871 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4672ba07-7cc5-43c1-a3db-c34c2db632e0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:15.465224 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4672ba07-7cc5-43c1-a3db-c34c2db632e0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.151268 May 19 15:07:15.465792 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 89/179] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:15 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:16.481653 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-64035f61-112f-411b-b844-8b131a16166d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:16.482263 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-64035f61-112f-411b-b844-8b131a16166d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:16.488343 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-64035f61-112f-411b-b844-8b131a16166d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:16.488797 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-64035f61-112f-411b-b844-8b131a16166d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:16.489555 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-64035f61-112f-411b-b844-8b131a16166d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:16.489996 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-64035f61-112f-411b-b844-8b131a16166d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:16.619465 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-64035f61-112f-411b-b844-8b131a16166d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:16.627253 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-64035f61-112f-411b-b844-8b131a16166d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.149381 May 19 15:07:16.627934 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 91/180] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:16 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:07:17.644316 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-5a5bb999-45ae-4082-8efa-681925938894 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:17.644890 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-5a5bb999-45ae-4082-8efa-681925938894 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:17.651827 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5a5bb999-45ae-4082-8efa-681925938894 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:17.652284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5a5bb999-45ae-4082-8efa-681925938894 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:17.653047 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5a5bb999-45ae-4082-8efa-681925938894 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:17.653491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5a5bb999-45ae-4082-8efa-681925938894 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:17.789170 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5a5bb999-45ae-4082-8efa-681925938894 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:17.796697 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-5a5bb999-45ae-4082-8efa-681925938894 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.156294 May 19 15:07:17.797188 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 90/181] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:17 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:18.813121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5bdedd56-34b3-43a6-8072-a14d6c980879 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:18.813734 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5bdedd56-34b3-43a6-8072-a14d6c980879 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:18.819691 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5bdedd56-34b3-43a6-8072-a14d6c980879 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:18.820139 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5bdedd56-34b3-43a6-8072-a14d6c980879 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:18.820939 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5bdedd56-34b3-43a6-8072-a14d6c980879 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:18.821327 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5bdedd56-34b3-43a6-8072-a14d6c980879 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:18.984486 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5bdedd56-34b3-43a6-8072-a14d6c980879 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:18.993335 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5bdedd56-34b3-43a6-8072-a14d6c980879 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.184003 May 19 15:07:18.994235 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 92/182] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:18 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:20.010917 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-0c12d10a-b332-44bc-a354-67197478cfb2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:20.011772 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-0c12d10a-b332-44bc-a354-67197478cfb2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:20.018755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0c12d10a-b332-44bc-a354-67197478cfb2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:20.019183 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0c12d10a-b332-44bc-a354-67197478cfb2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:20.019995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0c12d10a-b332-44bc-a354-67197478cfb2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:20.020735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0c12d10a-b332-44bc-a354-67197478cfb2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:20.218346 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-0c12d10a-b332-44bc-a354-67197478cfb2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:20.227374 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-0c12d10a-b332-44bc-a354-67197478cfb2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.220555 May 19 15:07:20.227920 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 91/183] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:20 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:21.245906 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3913e45a-421d-455f-bcc4-ae3fda302699 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:21.246528 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3913e45a-421d-455f-bcc4-ae3fda302699 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:21.252840 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3913e45a-421d-455f-bcc4-ae3fda302699 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:21.253305 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3913e45a-421d-455f-bcc4-ae3fda302699 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:21.254073 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3913e45a-421d-455f-bcc4-ae3fda302699 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:21.254513 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3913e45a-421d-455f-bcc4-ae3fda302699 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:21.420446 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3913e45a-421d-455f-bcc4-ae3fda302699 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:21.428425 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3913e45a-421d-455f-bcc4-ae3fda302699 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.187084 May 19 15:07:21.429019 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 93/184] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:21 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:22.446864 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a7415f2d-2345-47df-955c-29914c2d6f37 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:22.448237 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-a7415f2d-2345-47df-955c-29914c2d6f37 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:22.466142 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a7415f2d-2345-47df-955c-29914c2d6f37 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:22.466657 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a7415f2d-2345-47df-955c-29914c2d6f37 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:22.467428 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a7415f2d-2345-47df-955c-29914c2d6f37 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:22.467869 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a7415f2d-2345-47df-955c-29914c2d6f37 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:22.663615 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-a7415f2d-2345-47df-955c-29914c2d6f37 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:22.675555 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-a7415f2d-2345-47df-955c-29914c2d6f37 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.233957 May 19 15:07:22.676149 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 92/185] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:22 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:23.692612 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-aafd7d5b-0a0c-4486-a46d-bf8a2757454f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:23.693376 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-aafd7d5b-0a0c-4486-a46d-bf8a2757454f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:23.700343 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aafd7d5b-0a0c-4486-a46d-bf8a2757454f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:23.701314 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aafd7d5b-0a0c-4486-a46d-bf8a2757454f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:23.702229 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aafd7d5b-0a0c-4486-a46d-bf8a2757454f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:23.703240 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aafd7d5b-0a0c-4486-a46d-bf8a2757454f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:23.925731 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-aafd7d5b-0a0c-4486-a46d-bf8a2757454f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:23.938714 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-aafd7d5b-0a0c-4486-a46d-bf8a2757454f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.250010 May 19 15:07:23.949121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 94/186] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:23 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:24.958584 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-274643fd-aafd-45a2-a880-e0ab24b6e127 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:24.959867 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-274643fd-aafd-45a2-a880-e0ab24b6e127 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:24.967968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-274643fd-aafd-45a2-a880-e0ab24b6e127 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:24.968540 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-274643fd-aafd-45a2-a880-e0ab24b6e127 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:24.969417 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-274643fd-aafd-45a2-a880-e0ab24b6e127 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:24.970066 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-274643fd-aafd-45a2-a880-e0ab24b6e127 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:24.974331 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:25.179574 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-274643fd-aafd-45a2-a880-e0ab24b6e127 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:25.198908 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-274643fd-aafd-45a2-a880-e0ab24b6e127 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.245578 May 19 15:07:25.199713 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 93/187] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:24 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:26.216267 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-28ced3c9-1f6f-42ae-b1e4-8efd2452f0b5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:26.216871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-28ced3c9-1f6f-42ae-b1e4-8efd2452f0b5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:26.230380 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-28ced3c9-1f6f-42ae-b1e4-8efd2452f0b5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:26.231993 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-28ced3c9-1f6f-42ae-b1e4-8efd2452f0b5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:26.234481 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-28ced3c9-1f6f-42ae-b1e4-8efd2452f0b5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:26.235160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-28ced3c9-1f6f-42ae-b1e4-8efd2452f0b5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:26.422832 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-28ced3c9-1f6f-42ae-b1e4-8efd2452f0b5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:26.431008 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-28ced3c9-1f6f-42ae-b1e4-8efd2452f0b5 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.218491 May 19 15:07:26.431871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 95/188] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:26 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:27.452750 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-50ae1cc0-8c66-4fb4-903d-7b65bef5af81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:27.454043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-50ae1cc0-8c66-4fb4-903d-7b65bef5af81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:27.461923 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-50ae1cc0-8c66-4fb4-903d-7b65bef5af81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:27.462379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-50ae1cc0-8c66-4fb4-903d-7b65bef5af81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:27.463384 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-50ae1cc0-8c66-4fb4-903d-7b65bef5af81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:27.463826 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-50ae1cc0-8c66-4fb4-903d-7b65bef5af81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:27.617131 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-50ae1cc0-8c66-4fb4-903d-7b65bef5af81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:27.625435 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-50ae1cc0-8c66-4fb4-903d-7b65bef5af81 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.176398 May 19 15:07:27.626271 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 94/189] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:27 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:28.642430 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fae808f5-d2fc-41ac-8985-c8b3c768bee8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:28.643852 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fae808f5-d2fc-41ac-8985-c8b3c768bee8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:28.651810 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fae808f5-d2fc-41ac-8985-c8b3c768bee8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:28.652661 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fae808f5-d2fc-41ac-8985-c8b3c768bee8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:28.653616 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fae808f5-d2fc-41ac-8985-c8b3c768bee8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:28.654367 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fae808f5-d2fc-41ac-8985-c8b3c768bee8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:28.817990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fae808f5-d2fc-41ac-8985-c8b3c768bee8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:28.831099 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fae808f5-d2fc-41ac-8985-c8b3c768bee8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.189339 May 19 15:07:28.833460 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 96/190] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:28 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:29.851555 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c52be6f6-980d-4d21-8f58-9ac5b13d72ea tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:29.852944 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c52be6f6-980d-4d21-8f58-9ac5b13d72ea tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:29.866997 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c52be6f6-980d-4d21-8f58-9ac5b13d72ea tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:29.868102 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c52be6f6-980d-4d21-8f58-9ac5b13d72ea tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:29.869257 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c52be6f6-980d-4d21-8f58-9ac5b13d72ea tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:29.869769 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c52be6f6-980d-4d21-8f58-9ac5b13d72ea tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:30.035455 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c52be6f6-980d-4d21-8f58-9ac5b13d72ea tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:30.050455 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c52be6f6-980d-4d21-8f58-9ac5b13d72ea tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.205315 May 19 15:07:30.051282 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 95/191] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:29 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:31.068807 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-408099a7-1dd9-460f-983f-a6a9de42e2d9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:31.069526 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-408099a7-1dd9-460f-983f-a6a9de42e2d9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:31.076939 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-408099a7-1dd9-460f-983f-a6a9de42e2d9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:31.077498 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-408099a7-1dd9-460f-983f-a6a9de42e2d9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:31.078334 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-408099a7-1dd9-460f-983f-a6a9de42e2d9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:31.078927 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-408099a7-1dd9-460f-983f-a6a9de42e2d9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:31.234572 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-408099a7-1dd9-460f-983f-a6a9de42e2d9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:31.242569 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-408099a7-1dd9-460f-983f-a6a9de42e2d9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.177685 May 19 15:07:31.243144 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 97/192] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:31 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:32.259305 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a1cb4959-92ae-4624-8aa3-13196f612134 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:32.259918 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-a1cb4959-92ae-4624-8aa3-13196f612134 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:32.266951 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a1cb4959-92ae-4624-8aa3-13196f612134 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:32.267447 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a1cb4959-92ae-4624-8aa3-13196f612134 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:32.268508 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a1cb4959-92ae-4624-8aa3-13196f612134 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:32.268986 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a1cb4959-92ae-4624-8aa3-13196f612134 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:32.424596 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-a1cb4959-92ae-4624-8aa3-13196f612134 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:32.432855 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-a1cb4959-92ae-4624-8aa3-13196f612134 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1501 microversion: 2.1 time: 0.177680 May 19 15:07:32.433427 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 96/193] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:32 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1501 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:32.452286 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cc0c0898-e701-4a09-94ec-06e818213dff tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0edd039-15ed-489e-9a89-492f72dcdb07"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:32.453445 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cc0c0898-e701-4a09-94ec-06e818213dff tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:32.459515 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc0c0898-e701-4a09-94ec-06e818213dff tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:32.460529 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc0c0898-e701-4a09-94ec-06e818213dff tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:32.461586 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc0c0898-e701-4a09-94ec-06e818213dff tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:32.462675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cc0c0898-e701-4a09-94ec-06e818213dff tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:32.489020 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-cc0c0898-e701-4a09-94ec-06e818213dff tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] HTTP exception thrown: Cannot 'attach_volume' instance 1724bc45-95a0-405b-ac06-8e4ffe410b21 while it is in vm_state rescued May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cc0c0898-e701-4a09-94ec-06e818213dff tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Request method failure captured: May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: POST /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21/os-volume_attachments HTTP/1.1 May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 74 May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihlzDaKprO0909qPKc4F_OazQwwc5_Rbafbmht_l8WXneyGFtInLfgtI9qenFfnQFlXMiKiG_mNerNQSxrT4phnzSvWe7hKeozkgWzbgSMTg6jjqWsZx06axD917IRiSdc6jQEGzZZbBsd1kyhzNheIUk6IECPe14kqEerVf8vh7H9Tk May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 199f08479d9541bc936bb4ea80bae96a May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-632949355 May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:07:32.490587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:07:32.491871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_199f08479d9541bc936bb4ea80bae96a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/199f08479d9541bc936bb4ea80bae96a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/199f08479d9541bc936bb4ea80bae96a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/199f08479d9541bc936bb4ea80bae96a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:07:32.491871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-ServerRescueNegativeTestJSON-632949355 May 19 15:07:32.491871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 199f08479d9541bc936bb4ea80bae96a May 19 15:07:32.491871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-632949355 May 19 15:07:32.491871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-ServerRescueNegativeTestJSON-632949355-project May 19 15:07:32.491871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:07:32.491871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:07:32.491871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: e5374c90f38b47fcb611e346f3f2ec69 May 19 15:07:32.491871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-ServerRescueNegativeTestJSON-632949355-project May 19 15:07:32.491871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: May 19 15:07:32.491871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {"volumeAttachment": {"volumeId": "b0edd039-15ed-489e-9a89-492f72dcdb07"}} May 19 15:07:32.491871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Cannot 'attach_volume' instance 1724bc45-95a0-405b-ac06-8e4ffe410b21 while it is in vm_state rescued May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'server_id': '1724bc45-95a0-405b-ac06-8e4ffe410b21', 'body': {'volumeAttachment': {'volumeId': 'b0edd039-15ed-489e-9a89-492f72dcdb07'}}} May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1724bc45-95a0-405b-ac06-8e4ffe410b21 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:07:32.492571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1724bc45-95a0-405b-ac06-8e4ffe410b21 while it is in vm_state rescued May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:07:32.493619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:07:32.494783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:07:32.494783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:07:32.494783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1724bc45-95a0-405b-ac06-8e4ffe410b21 while it is in vm_state rescued May 19 15:07:32.494783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:07:32.497208 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cc0c0898-e701-4a09-94ec-06e818213dff tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Returning 409 to user: Cannot 'attach_volume' instance 1724bc45-95a0-405b-ac06-8e4ffe410b21 while it is in vm_state rescued {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:07:32.498496 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cc0c0898-e701-4a09-94ec-06e818213dff tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "POST /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051420 May 19 15:07:32.499409 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 98/194] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 15:07:32 2022] POST /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 15:07:32.508513 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-5b76c81d-0eef-4f1f-8a66-fb7b266c408a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:32.509105 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-5b76c81d-0eef-4f1f-8a66-fb7b266c408a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:32.515775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5b76c81d-0eef-4f1f-8a66-fb7b266c408a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:32.516413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5b76c81d-0eef-4f1f-8a66-fb7b266c408a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:32.517222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5b76c81d-0eef-4f1f-8a66-fb7b266c408a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:32.517618 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5b76c81d-0eef-4f1f-8a66-fb7b266c408a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:32.591145 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-5b76c81d-0eef-4f1f-8a66-fb7b266c408a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "POST /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21/action" status: 202 len: 0 microversion: 2.1 time: 0.087001 May 19 15:07:32.591922 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 97/195] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 15:07:32 2022] POST /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 15:07:32.601918 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-865d80bb-f232-449a-a4a4-0261a830ec7c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:32.602604 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-865d80bb-f232-449a-a4a4-0261a830ec7c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:32.610154 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-865d80bb-f232-449a-a4a4-0261a830ec7c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:32.610686 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-865d80bb-f232-449a-a4a4-0261a830ec7c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:32.611881 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-865d80bb-f232-449a-a4a4-0261a830ec7c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:32.612339 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-865d80bb-f232-449a-a4a4-0261a830ec7c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:32.753159 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-865d80bb-f232-449a-a4a4-0261a830ec7c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:32.765974 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-865d80bb-f232-449a-a4a4-0261a830ec7c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1509 microversion: 2.1 time: 0.168436 May 19 15:07:32.767898 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 99/196] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:32 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:33.233272 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-16ac1321-a61c-4a75-a4dd-fc0db0732a23 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:33.233970 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-16ac1321-a61c-4a75-a4dd-fc0db0732a23 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:33.241666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-16ac1321-a61c-4a75-a4dd-fc0db0732a23 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:33.242437 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-16ac1321-a61c-4a75-a4dd-fc0db0732a23 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:33.243790 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-16ac1321-a61c-4a75-a4dd-fc0db0732a23 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:33.244300 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-16ac1321-a61c-4a75-a4dd-fc0db0732a23 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:33.271052 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-16ac1321-a61c-4a75-a4dd-fc0db0732a23 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/ips" status: 200 len: 151 microversion: 2.20 time: 0.042911 May 19 15:07:33.271672 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 98/197] 10.222.0.24 () {60 vars in 1288 bytes} [Thu May 19 15:07:33 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 15:07:33.790657 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e632a6a2-f61b-4b83-8ed4-617abf6754d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:33.791353 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e632a6a2-f61b-4b83-8ed4-617abf6754d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:33.797512 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e632a6a2-f61b-4b83-8ed4-617abf6754d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:33.798246 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e632a6a2-f61b-4b83-8ed4-617abf6754d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:33.798728 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e632a6a2-f61b-4b83-8ed4-617abf6754d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:33.799368 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e632a6a2-f61b-4b83-8ed4-617abf6754d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:33.933831 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e632a6a2-f61b-4b83-8ed4-617abf6754d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:33.941184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e632a6a2-f61b-4b83-8ed4-617abf6754d8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1509 microversion: 2.1 time: 0.156160 May 19 15:07:33.941826 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 100/198] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:33 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:07:34.959360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f5fec6c1-282d-4c8a-8cf6-eca9a6d4c404 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:34.961276 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f5fec6c1-282d-4c8a-8cf6-eca9a6d4c404 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:34.973706 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=31 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:34.976284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f5fec6c1-282d-4c8a-8cf6-eca9a6d4c404 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:34.977159 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f5fec6c1-282d-4c8a-8cf6-eca9a6d4c404 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:34.978462 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f5fec6c1-282d-4c8a-8cf6-eca9a6d4c404 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:34.979245 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f5fec6c1-282d-4c8a-8cf6-eca9a6d4c404 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:35.155053 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f5fec6c1-282d-4c8a-8cf6-eca9a6d4c404 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:35.164521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f5fec6c1-282d-4c8a-8cf6-eca9a6d4c404 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1509 microversion: 2.1 time: 0.210243 May 19 15:07:35.165090 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 99/199] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:34 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:35.422852 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-40dca6e2-ad78-4d40-869b-1f13c851edb4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:35.423423 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-40dca6e2-ad78-4d40-869b-1f13c851edb4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:35.425671 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=31 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:35.435685 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40dca6e2-ad78-4d40-869b-1f13c851edb4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:35.436224 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40dca6e2-ad78-4d40-869b-1f13c851edb4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:35.437147 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40dca6e2-ad78-4d40-869b-1f13c851edb4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:35.437715 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40dca6e2-ad78-4d40-869b-1f13c851edb4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:35.441491 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=89 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:35.466843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-40dca6e2-ad78-4d40-869b-1f13c851edb4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3/ips" status: 200 len: 149 microversion: 2.1 time: 0.046360 May 19 15:07:35.468710 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 101/200] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 15:07:35 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:07:36.183280 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-07872403-64bb-495b-81d4-05084152e316 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:36.184253 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-07872403-64bb-495b-81d4-05084152e316 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:36.191244 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-07872403-64bb-495b-81d4-05084152e316 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:36.191703 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-07872403-64bb-495b-81d4-05084152e316 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:36.192713 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-07872403-64bb-495b-81d4-05084152e316 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:36.193473 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-07872403-64bb-495b-81d4-05084152e316 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:36.339393 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-07872403-64bb-495b-81d4-05084152e316 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:36.347136 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-07872403-64bb-495b-81d4-05084152e316 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1509 microversion: 2.1 time: 0.168774 May 19 15:07:36.347747 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 100/201] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:36 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:07:36.653650 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6e6eabf9-e3e0-49e8-87ee-50b969993f7f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:36.654180 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6e6eabf9-e3e0-49e8-87ee-50b969993f7f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:36.660187 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6e6eabf9-e3e0-49e8-87ee-50b969993f7f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:36.660643 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6e6eabf9-e3e0-49e8-87ee-50b969993f7f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:36.661446 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6e6eabf9-e3e0-49e8-87ee-50b969993f7f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:36.661886 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6e6eabf9-e3e0-49e8-87ee-50b969993f7f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:36.685702 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-6e6eabf9-e3e0-49e8-87ee-50b969993f7f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lazy-loading 'flavor' on Instance uuid 6324753a-5912-42c2-a1f4-0bc631bea605 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:07:36.861970 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-5e11458e-80ca-40a4-9933-396def60891e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67697683-0e47-4b4b-b016-2bd493adc6b6"}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:36.863095 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-5e11458e-80ca-40a4-9933-396def60891e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:36.869721 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5e11458e-80ca-40a4-9933-396def60891e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:36.870447 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5e11458e-80ca-40a4-9933-396def60891e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:36.871222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5e11458e-80ca-40a4-9933-396def60891e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:36.871837 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5e11458e-80ca-40a4-9933-396def60891e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:36.949412 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6e6eabf9-e3e0-49e8-87ee-50b969993f7f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "POST /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/action" status: 202 len: 0 microversion: 2.20 time: 0.300565 May 19 15:07:36.950110 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 102/202] 10.222.0.24 () {62 vars in 1318 bytes} [Thu May 19 15:07:36 2022] POST /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 15:07:36.959051 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a1ce6df6-282b-4414-9d66-79c6c469e4a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:36.959828 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a1ce6df6-282b-4414-9d66-79c6c469e4a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:36.966225 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1ce6df6-282b-4414-9d66-79c6c469e4a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:36.966680 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1ce6df6-282b-4414-9d66-79c6c469e4a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:36.967647 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1ce6df6-282b-4414-9d66-79c6c469e4a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:36.968098 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1ce6df6-282b-4414-9d66-79c6c469e4a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:37.101990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a1ce6df6-282b-4414-9d66-79c6c469e4a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:37.110040 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a1ce6df6-282b-4414-9d66-79c6c469e4a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:37.111584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a1ce6df6-282b-4414-9d66-79c6c469e4a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:37.112749 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a1ce6df6-282b-4414-9d66-79c6c469e4a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.158032 May 19 15:07:37.113308 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 103/203] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:36 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:07:37.368535 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8c96a466-91b9-4030-81dc-4365f9147422 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:37.369424 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8c96a466-91b9-4030-81dc-4365f9147422 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:37.378833 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c96a466-91b9-4030-81dc-4365f9147422 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:37.379418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c96a466-91b9-4030-81dc-4365f9147422 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:37.380275 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c96a466-91b9-4030-81dc-4365f9147422 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:37.381384 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8c96a466-91b9-4030-81dc-4365f9147422 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:37.547295 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8c96a466-91b9-4030-81dc-4365f9147422 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:37.558249 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8c96a466-91b9-4030-81dc-4365f9147422 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1509 microversion: 2.1 time: 0.196186 May 19 15:07:37.559941 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 104/204] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:37 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:37.616270 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-19095083", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "networks": [{"uuid": "caae226b-eb30-4cc3-81ca-a5536dcb8101"}]}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:37.696573 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] validate_networks() for [('caae226b-eb30-4cc3-81ca-a5536dcb8101', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:07:37.809791 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-5e11458e-80ca-40a4-9933-396def60891e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "POST /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.951526 May 19 15:07:37.812776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 101/205] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 15:07:36 2022] POST /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3/os-volume_attachments => generated 194 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:07:38.136334 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-40cf91a1-6432-427a-87c0-f80a2c5c3f99 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:38.137346 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-40cf91a1-6432-427a-87c0-f80a2c5c3f99 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:38.147781 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-40cf91a1-6432-427a-87c0-f80a2c5c3f99 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:38.148498 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-40cf91a1-6432-427a-87c0-f80a2c5c3f99 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:38.149492 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-40cf91a1-6432-427a-87c0-f80a2c5c3f99 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:38.150091 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-40cf91a1-6432-427a-87c0-f80a2c5c3f99 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:38.387180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-40cf91a1-6432-427a-87c0-f80a2c5c3f99 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:38.395379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-40cf91a1-6432-427a-87c0-f80a2c5c3f99 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:38.397639 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-40cf91a1-6432-427a-87c0-f80a2c5c3f99 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:38.398810 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-40cf91a1-6432-427a-87c0-f80a2c5c3f99 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.269152 May 19 15:07:38.399575 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 102/206] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:38 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:07:38.416053 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:07:38.417528 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:07:38.418007 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:07:38.418503 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:07:38.418919 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:07:38.428719 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:38.429110 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:38.429906 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:38.430343 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:38.449192 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Getting quotas for project 8f7a1fc211304ed3a001282402fa73cc. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:07:38.453329 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Getting quotas for user f7d796b832c442c0a2af8ef603879f30 and project 8f7a1fc211304ed3a001282402fa73cc. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:07:38.465130 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:07:38.467443 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:07:38.525533 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-156cd8a9-e483-4475-bcce-7fa5c273b6bd tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.913522 May 19 15:07:38.528777 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 105/207] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:07:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 15:07:38.539001 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-0b97fe2a-3ed1-4967-b47a-223c6cf32cd7 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:38.539676 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-0b97fe2a-3ed1-4967-b47a-223c6cf32cd7 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:38.580248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-460adfe7-b714-4b18-b3f9-96ab1ddd651d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:38.581087 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-460adfe7-b714-4b18-b3f9-96ab1ddd651d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:38.591175 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-460adfe7-b714-4b18-b3f9-96ab1ddd651d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:38.591899 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-460adfe7-b714-4b18-b3f9-96ab1ddd651d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:38.593071 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-460adfe7-b714-4b18-b3f9-96ab1ddd651d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:38.593931 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-460adfe7-b714-4b18-b3f9-96ab1ddd651d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:38.606623 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-0b97fe2a-3ed1-4967-b47a-223c6cf32cd7 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:38.613834 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-0b97fe2a-3ed1-4967-b47a-223c6cf32cd7 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd" status: 200 len: 1217 microversion: 2.1 time: 0.079438 May 19 15:07:38.614968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 103/208] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:38 2022] GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:38.759766 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-460adfe7-b714-4b18-b3f9-96ab1ddd651d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:38.772234 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-460adfe7-b714-4b18-b3f9-96ab1ddd651d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1515 microversion: 2.1 time: 0.195423 May 19 15:07:38.772997 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 106/209] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:38 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:39.417563 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9d526255-0090-4766-a21d-31291f3e7c55 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:39.418177 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-9d526255-0090-4766-a21d-31291f3e7c55 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:39.426786 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9d526255-0090-4766-a21d-31291f3e7c55 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:39.427266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9d526255-0090-4766-a21d-31291f3e7c55 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:39.428355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9d526255-0090-4766-a21d-31291f3e7c55 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:39.428800 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9d526255-0090-4766-a21d-31291f3e7c55 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:39.630895 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9d526255-0090-4766-a21d-31291f3e7c55 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:39.645295 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8a7ac66c-5bf1-4ead-8d8f-ad6eaecc4731 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:39.645909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8a7ac66c-5bf1-4ead-8d8f-ad6eaecc4731 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:39.659886 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9d526255-0090-4766-a21d-31291f3e7c55 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:39.661369 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9d526255-0090-4766-a21d-31291f3e7c55 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:39.664438 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8a7ac66c-5bf1-4ead-8d8f-ad6eaecc4731 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:39.664726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8a7ac66c-5bf1-4ead-8d8f-ad6eaecc4731 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:39.666031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8a7ac66c-5bf1-4ead-8d8f-ad6eaecc4731 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:39.667989 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9d526255-0090-4766-a21d-31291f3e7c55 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.254163 May 19 15:07:39.668599 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 104/210] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:39 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:07:39.669025 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8a7ac66c-5bf1-4ead-8d8f-ad6eaecc4731 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:39.777727 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8a7ac66c-5bf1-4ead-8d8f-ad6eaecc4731 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:39.799291 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8a7ac66c-5bf1-4ead-8d8f-ad6eaecc4731 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd" status: 200 len: 1269 microversion: 2.1 time: 0.170739 May 19 15:07:39.800164 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 107/211] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:39 2022] GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:40.304581 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-0d2591da-6011-4f7c-9ee2-d789827435d3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Action: 'create', calling method: .version_select at 0x7f35d162c8b0>, body: {"keypair": {"name": "tempest-keypair-2128424100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD10H1iv722cjLZT2qcxjEEkDcgc10zlfhmnaGWwhbXzL8gjpzjEkr2e49cnX5/wLx/QzFGfGV65yqgqXqip3QuxbMC8HFN0Eon7yy1HFrcab9CuefZ4S1+0wlD2JADBMA=="}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:40.327623 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-0d2591da-6011-4f7c-9ee2-d789827435d3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Getting quotas for project 199f08479d9541bc936bb4ea80bae96a. Resources: {'key_pairs'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:07:40.332107 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-0d2591da-6011-4f7c-9ee2-d789827435d3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Getting quotas for user e5374c90f38b47fcb611e346f3f2ec69 and project 199f08479d9541bc936bb4ea80bae96a. Resources: {'key_pairs'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:07:40.389455 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-0d2591da-6011-4f7c-9ee2-d789827435d3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.090189 May 19 15:07:40.391899 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 105/212] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 15:07:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:07:40.691786 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7e78c28b-3b21-4a6f-ba09-23371bb68a27 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:40.692717 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7e78c28b-3b21-4a6f-ba09-23371bb68a27 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:40.707337 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e78c28b-3b21-4a6f-ba09-23371bb68a27 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:40.707913 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e78c28b-3b21-4a6f-ba09-23371bb68a27 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:40.717796 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e78c28b-3b21-4a6f-ba09-23371bb68a27 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:40.723366 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e78c28b-3b21-4a6f-ba09-23371bb68a27 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:40.822574 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-5f75777d-fadb-4c24-b87d-7fb118cc9834 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:40.825431 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-5f75777d-fadb-4c24-b87d-7fb118cc9834 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:40.850150 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5f75777d-fadb-4c24-b87d-7fb118cc9834 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:40.851475 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5f75777d-fadb-4c24-b87d-7fb118cc9834 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:40.852434 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5f75777d-fadb-4c24-b87d-7fb118cc9834 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:40.853071 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5f75777d-fadb-4c24-b87d-7fb118cc9834 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:41.064637 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7e78c28b-3b21-4a6f-ba09-23371bb68a27 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:41.074498 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7e78c28b-3b21-4a6f-ba09-23371bb68a27 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:41.076286 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7e78c28b-3b21-4a6f-ba09-23371bb68a27 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:41.077655 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7e78c28b-3b21-4a6f-ba09-23371bb68a27 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.392654 May 19 15:07:41.078399 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 108/213] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:40 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:07:41.250145 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5f75777d-fadb-4c24-b87d-7fb118cc9834 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:41.261815 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-5f75777d-fadb-4c24-b87d-7fb118cc9834 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd" status: 200 len: 1317 microversion: 2.1 time: 0.446191 May 19 15:07:41.262438 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 106/214] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:40 2022] GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:41.674966 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-b6b188b9-10b9-4bff-b1e5-11e40fd94c6a req-25c9a4b9-dc84-4d51-bbdd-346d83669de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abfb9153-3ce0-4a77-bcaf-ff150167e0cd", "tag": "8dce6e6e-d156-430b-8f9c-e219fc9db6df"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:41.708559 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-b6b188b9-10b9-4bff-b1e5-11e40fd94c6a req-25c9a4b9-dc84-4d51-bbdd-346d83669de2 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:41.709009 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-b6b188b9-10b9-4bff-b1e5-11e40fd94c6a req-25c9a4b9-dc84-4d51-bbdd-346d83669de2 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:41.724390 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-b6b188b9-10b9-4bff-b1e5-11e40fd94c6a req-25c9a4b9-dc84-4d51-bbdd-346d83669de2 service nova] Creating event network-changed:8dce6e6e-d156-430b-8f9c-e219fc9db6df for instance abfb9153-3ce0-4a77-bcaf-ff150167e0cd on hv-cinder-82549 May 19 15:07:41.743617 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-b6b188b9-10b9-4bff-b1e5-11e40fd94c6a req-25c9a4b9-dc84-4d51-bbdd-346d83669de2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082613 May 19 15:07:41.753325 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 109/215] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:07:42.096621 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-53405f06-53ce-48ee-8f46-7b2da82f6149 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:42.097174 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-53405f06-53ce-48ee-8f46-7b2da82f6149 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:42.104428 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-53405f06-53ce-48ee-8f46-7b2da82f6149 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:42.105137 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-53405f06-53ce-48ee-8f46-7b2da82f6149 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:42.106086 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-53405f06-53ce-48ee-8f46-7b2da82f6149 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:42.106673 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-53405f06-53ce-48ee-8f46-7b2da82f6149 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:42.279168 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-097d1df6-be4c-4a2e-a887-08e8f60f4ef1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:42.279925 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-097d1df6-be4c-4a2e-a887-08e8f60f4ef1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:42.291867 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-097d1df6-be4c-4a2e-a887-08e8f60f4ef1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:42.292336 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-097d1df6-be4c-4a2e-a887-08e8f60f4ef1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:42.293126 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-097d1df6-be4c-4a2e-a887-08e8f60f4ef1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:42.293596 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-097d1df6-be4c-4a2e-a887-08e8f60f4ef1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:42.418716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-53405f06-53ce-48ee-8f46-7b2da82f6149 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:42.430090 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-53405f06-53ce-48ee-8f46-7b2da82f6149 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:42.432018 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-53405f06-53ce-48ee-8f46-7b2da82f6149 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:42.434834 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-53405f06-53ce-48ee-8f46-7b2da82f6149 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.340873 May 19 15:07:42.448651 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 107/216] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:42 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:07:42.566779 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-097d1df6-be4c-4a2e-a887-08e8f60f4ef1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:42.581133 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-097d1df6-be4c-4a2e-a887-08e8f60f4ef1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd" status: 200 len: 1317 microversion: 2.1 time: 0.306099 May 19 15:07:42.583366 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 110/217] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:42 2022] GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:43.305253 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-344879141", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fba0d92a-cc3d-4407-a8fd-52349f4553f3"}], "security_groups": [{"name": "tempest-securitygroup--1462772361"}], "key_name": "tempest-keypair-2128424100", "user_data": "}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:43.450576 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.network.neutron [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] validate_networks() for [('fba0d92a-cc3d-4407-a8fd-52349f4553f3', None, None, None, None, None)] {{(pid=117445) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:07:43.454524 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e7fe3eb5-5d95-4884-a1fe-09b9e936cbad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:43.455817 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e7fe3eb5-5d95-4884-a1fe-09b9e936cbad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:43.470390 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7fe3eb5-5d95-4884-a1fe-09b9e936cbad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:43.471169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7fe3eb5-5d95-4884-a1fe-09b9e936cbad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:43.472868 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7fe3eb5-5d95-4884-a1fe-09b9e936cbad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:43.473482 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7fe3eb5-5d95-4884-a1fe-09b9e936cbad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:43.690914 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e7fe3eb5-5d95-4884-a1fe-09b9e936cbad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:43.707984 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e7fe3eb5-5d95-4884-a1fe-09b9e936cbad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:43.715233 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e7fe3eb5-5d95-4884-a1fe-09b9e936cbad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:43.716642 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e7fe3eb5-5d95-4884-a1fe-09b9e936cbad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.266657 May 19 15:07:43.728532 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 111/218] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:43 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:07:43.733806 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8e25059c-791a-4f10-ab7e-f1141a3512ef tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:43.734719 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8e25059c-791a-4f10-ab7e-f1141a3512ef tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:43.742203 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e25059c-791a-4f10-ab7e-f1141a3512ef tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:43.742814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e25059c-791a-4f10-ab7e-f1141a3512ef tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:43.743911 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e25059c-791a-4f10-ab7e-f1141a3512ef tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:43.744580 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e25059c-791a-4f10-ab7e-f1141a3512ef tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:44.078353 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8e25059c-791a-4f10-ab7e-f1141a3512ef tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:44.094135 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8e25059c-791a-4f10-ab7e-f1141a3512ef tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd" status: 200 len: 1317 microversion: 2.1 time: 0.363350 May 19 15:07:44.094794 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 112/219] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:43 2022] GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:44.138739 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Flavor limits 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:07:44.139415 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Image limits 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:07:44.139927 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Flavor pref 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:07:44.140342 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Image pref 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:07:44.140758 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:07:44.151084 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:44.151953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:44.154032 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:44.154652 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:44.194172 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Getting quotas for project 199f08479d9541bc936bb4ea80bae96a. Resources: {'cores', 'instances', 'ram'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:07:44.198470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Getting quotas for user e5374c90f38b47fcb611e346f3f2ec69 and project 199f08479d9541bc936bb4ea80bae96a. Resources: {'cores', 'instances', 'ram'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:07:44.211702 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Going to run 1 instances... {{(pid=117445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:07:44.215070 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:07:44.297405 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-da2ea00f-c358-47e7-a3fd-37d98784a3a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.998470 May 19 15:07:44.298132 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 108/220] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:07:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:07:44.309491 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d945e4de-3341-4d83-88f7-d190a04b398f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:44.310826 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d945e4de-3341-4d83-88f7-d190a04b398f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:44.433431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d945e4de-3341-4d83-88f7-d190a04b398f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:44.442967 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d945e4de-3341-4d83-88f7-d190a04b398f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1245 microversion: 2.1 time: 0.137490 May 19 15:07:44.445116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 113/221] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:44 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1245 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:44.737612 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-74663651-32fd-48f1-b861-50c0cfecf88d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:44.738218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-74663651-32fd-48f1-b861-50c0cfecf88d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:44.755417 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-74663651-32fd-48f1-b861-50c0cfecf88d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:44.758521 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-74663651-32fd-48f1-b861-50c0cfecf88d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:44.760986 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-74663651-32fd-48f1-b861-50c0cfecf88d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:44.762035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-74663651-32fd-48f1-b861-50c0cfecf88d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:45.054143 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-74663651-32fd-48f1-b861-50c0cfecf88d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:45.072721 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-74663651-32fd-48f1-b861-50c0cfecf88d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:45.074883 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-74663651-32fd-48f1-b861-50c0cfecf88d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:45.077898 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-74663651-32fd-48f1-b861-50c0cfecf88d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.344367 May 19 15:07:45.079257 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 109/222] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:44 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:07:45.115878 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1d94b651-e426-4dcf-88dc-153b8c1ff739 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:45.117147 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1d94b651-e426-4dcf-88dc-153b8c1ff739 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:45.133498 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1d94b651-e426-4dcf-88dc-153b8c1ff739 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:45.136209 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1d94b651-e426-4dcf-88dc-153b8c1ff739 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:45.140621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1d94b651-e426-4dcf-88dc-153b8c1ff739 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:45.141164 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1d94b651-e426-4dcf-88dc-153b8c1ff739 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:45.394146 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1d94b651-e426-4dcf-88dc-153b8c1ff739 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:45.403464 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1d94b651-e426-4dcf-88dc-153b8c1ff739 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd" status: 200 len: 1317 microversion: 2.1 time: 0.294549 May 19 15:07:45.404066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 114/223] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:45 2022] GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:45.461980 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f4832cf3-de76-4373-95a5-90258c699fe6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:45.462886 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f4832cf3-de76-4373-95a5-90258c699fe6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:45.469231 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f4832cf3-de76-4373-95a5-90258c699fe6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:45.470139 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f4832cf3-de76-4373-95a5-90258c699fe6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:45.471131 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f4832cf3-de76-4373-95a5-90258c699fe6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:45.471796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f4832cf3-de76-4373-95a5-90258c699fe6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:45.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:45.572193 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f4832cf3-de76-4373-95a5-90258c699fe6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:45.585434 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f4832cf3-de76-4373-95a5-90258c699fe6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1297 microversion: 2.1 time: 0.126373 May 19 15:07:45.586230 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 110/224] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:45 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1297 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:45.608956 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-349bf373-8e19-4e8f-922b-d919be56989d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Action: 'create', calling method: .version_select at 0x7f35d178c790>, body: {"keypair": {"name": "tempest-keypair-330766060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnD+Qx5+D3dfsQf33dv0UUf+DxHOCXxULvpbYOtdDlh+5aOgHY5wO72+QDXfBTcA6Cyl6FdTtgtjS28WNJY1b+49rWAdc3WXceFyJPT0cnDCltF5JNSVwCMrL/G1GlP1A=="}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:45.644564 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-349bf373-8e19-4e8f-922b-d919be56989d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for project 34c1099557144b8bb2fff88f5b526834. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:07:45.651223 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-349bf373-8e19-4e8f-922b-d919be56989d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for user af7838e525a042dfa0357ad1fc58cf21 and project 34c1099557144b8bb2fff88f5b526834. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:07:45.685782 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-349bf373-8e19-4e8f-922b-d919be56989d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.081220 May 19 15:07:45.697936 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 115/225] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 15:07:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:07:46.097850 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-852d48f7-7097-4260-ba21-bce3188031bb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:46.098835 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-852d48f7-7097-4260-ba21-bce3188031bb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:46.118504 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-852d48f7-7097-4260-ba21-bce3188031bb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:46.126971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-852d48f7-7097-4260-ba21-bce3188031bb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:46.127847 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-852d48f7-7097-4260-ba21-bce3188031bb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:46.128465 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-852d48f7-7097-4260-ba21-bce3188031bb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:46.408768 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-852d48f7-7097-4260-ba21-bce3188031bb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:46.418861 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-852d48f7-7097-4260-ba21-bce3188031bb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:46.420637 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-852d48f7-7097-4260-ba21-bce3188031bb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:46.421986 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-852d48f7-7097-4260-ba21-bce3188031bb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.328678 May 19 15:07:46.422171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-30807119-4371-4a6f-88ba-bc98f38c60cc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:46.422859 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-30807119-4371-4a6f-88ba-bc98f38c60cc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:46.423497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 111/226] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:46 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:07:46.434012 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-30807119-4371-4a6f-88ba-bc98f38c60cc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:46.435270 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-30807119-4371-4a6f-88ba-bc98f38c60cc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:46.436602 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-30807119-4371-4a6f-88ba-bc98f38c60cc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:46.437254 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-30807119-4371-4a6f-88ba-bc98f38c60cc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:46.611381 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ec83015d-f0fd-4a23-b1f5-aa5738a758ca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:46.612640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ec83015d-f0fd-4a23-b1f5-aa5738a758ca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:46.643115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ec83015d-f0fd-4a23-b1f5-aa5738a758ca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:46.645749 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ec83015d-f0fd-4a23-b1f5-aa5738a758ca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:46.648262 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ec83015d-f0fd-4a23-b1f5-aa5738a758ca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:46.650452 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ec83015d-f0fd-4a23-b1f5-aa5738a758ca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:46.702177 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-30807119-4371-4a6f-88ba-bc98f38c60cc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:46.710315 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-30807119-4371-4a6f-88ba-bc98f38c60cc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd" status: 200 len: 1317 microversion: 2.1 time: 0.292532 May 19 15:07:46.710898 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 116/227] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:46 2022] GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:46.823063 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ec83015d-f0fd-4a23-b1f5-aa5738a758ca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:46.832963 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ec83015d-f0fd-4a23-b1f5-aa5738a758ca tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1303 microversion: 2.1 time: 0.232288 May 19 15:07:46.834813 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 112/228] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:46 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:07:47.025630 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-414a2230-c539-4714-afe6-bb54c5472a45 req-ab4e8f18-ef76-4c57-b019-cfd83206e1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abfb9153-3ce0-4a77-bcaf-ff150167e0cd", "name": "network-vif-plugged", "status": "completed", "tag": "8dce6e6e-d156-430b-8f9c-e219fc9db6df"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:47.034191 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-414a2230-c539-4714-afe6-bb54c5472a45 req-ab4e8f18-ef76-4c57-b019-cfd83206e1b9 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:47.034978 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-414a2230-c539-4714-afe6-bb54c5472a45 req-ab4e8f18-ef76-4c57-b019-cfd83206e1b9 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:47.047463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-414a2230-c539-4714-afe6-bb54c5472a45 req-ab4e8f18-ef76-4c57-b019-cfd83206e1b9 service nova] Creating event network-vif-plugged:8dce6e6e-d156-430b-8f9c-e219fc9db6df for instance abfb9153-3ce0-4a77-bcaf-ff150167e0cd on hv-cinder-82549 May 19 15:07:47.054055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-414a2230-c539-4714-afe6-bb54c5472a45 req-ab4e8f18-ef76-4c57-b019-cfd83206e1b9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032296 May 19 15:07:47.055381 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 117/229] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:07:47.442606 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-78de6d3f-0d13-43c2-b32b-1df7790dc35e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:47.444004 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-78de6d3f-0d13-43c2-b32b-1df7790dc35e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:47.456740 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-78de6d3f-0d13-43c2-b32b-1df7790dc35e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:47.457418 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-78de6d3f-0d13-43c2-b32b-1df7790dc35e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:47.460296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-78de6d3f-0d13-43c2-b32b-1df7790dc35e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:47.460987 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-78de6d3f-0d13-43c2-b32b-1df7790dc35e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:47.756515 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6c97116c-f6ba-4ab8-92f9-9ddbf0155fe1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:47.757998 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6c97116c-f6ba-4ab8-92f9-9ddbf0155fe1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:47.772564 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6c97116c-f6ba-4ab8-92f9-9ddbf0155fe1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:47.773409 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6c97116c-f6ba-4ab8-92f9-9ddbf0155fe1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:47.774740 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6c97116c-f6ba-4ab8-92f9-9ddbf0155fe1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:47.775515 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6c97116c-f6ba-4ab8-92f9-9ddbf0155fe1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:47.937695 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-78de6d3f-0d13-43c2-b32b-1df7790dc35e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:47.962306 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-78de6d3f-0d13-43c2-b32b-1df7790dc35e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:47.967903 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-78de6d3f-0d13-43c2-b32b-1df7790dc35e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:47.970054 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-78de6d3f-0d13-43c2-b32b-1df7790dc35e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.532068 May 19 15:07:47.972546 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 113/230] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:47 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:07:47.984149 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7a7bcdb3-ee41-4f1f-bcb5-a8226aa84606 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:47.985605 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7a7bcdb3-ee41-4f1f-bcb5-a8226aa84606 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:47.997074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a7bcdb3-ee41-4f1f-bcb5-a8226aa84606 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:47.997943 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a7bcdb3-ee41-4f1f-bcb5-a8226aa84606 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:47.999145 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a7bcdb3-ee41-4f1f-bcb5-a8226aa84606 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:47.999852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a7bcdb3-ee41-4f1f-bcb5-a8226aa84606 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:48.108702 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6c97116c-f6ba-4ab8-92f9-9ddbf0155fe1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:48.117931 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6c97116c-f6ba-4ab8-92f9-9ddbf0155fe1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd" status: 200 len: 1317 microversion: 2.1 time: 0.390640 May 19 15:07:48.128218 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 118/231] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:47 2022] GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:48.548539 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7a7bcdb3-ee41-4f1f-bcb5-a8226aa84606 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:48.585156 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7a7bcdb3-ee41-4f1f-bcb5-a8226aa84606 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1371 microversion: 2.1 time: 0.610825 May 19 15:07:48.588295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 114/232] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:47 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1371 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:48.801759 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-115955524", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c03712e-3615-4599-bcae-117320ca4aeb"}], "security_groups": [{"name": "tempest-securitygroup--1051724951"}], "key_name": "tempest-keypair-330766060", "user_data": "}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:48.816794 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:48.925588 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-91fc9036-c7a3-4230-9c0c-329816c0df63 req-5117b8f5-2dc7-48de-83a5-60bc2d42963a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b30b6fd-1ba9-4939-baeb-d0fb305b1176", "tag": "7377972f-e26c-43d1-ac62-ddf4b52e4bfd"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:48.964755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-91fc9036-c7a3-4230-9c0c-329816c0df63 req-5117b8f5-2dc7-48de-83a5-60bc2d42963a service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:48.965329 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-91fc9036-c7a3-4230-9c0c-329816c0df63 req-5117b8f5-2dc7-48de-83a5-60bc2d42963a service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:48.990961 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-91fc9036-c7a3-4230-9c0c-329816c0df63 req-5117b8f5-2dc7-48de-83a5-60bc2d42963a service nova] Creating event network-changed:7377972f-e26c-43d1-ac62-ddf4b52e4bfd for instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 on hv-cinder-82549 May 19 15:07:49.000880 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-91fc9036-c7a3-4230-9c0c-329816c0df63 req-5117b8f5-2dc7-48de-83a5-60bc2d42963a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084821 May 19 15:07:49.002083 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 115/233] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:07:49.012927 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ba30557b-3a0c-44cf-9f62-3578798e35ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:49.014888 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ba30557b-3a0c-44cf-9f62-3578798e35ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:49.029042 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] validate_networks() for [('6c03712e-3615-4599-bcae-117320ca4aeb', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:07:49.038273 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ba30557b-3a0c-44cf-9f62-3578798e35ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:49.038828 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ba30557b-3a0c-44cf-9f62-3578798e35ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:49.039650 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ba30557b-3a0c-44cf-9f62-3578798e35ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:49.042178 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ba30557b-3a0c-44cf-9f62-3578798e35ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:49.589738 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ba30557b-3a0c-44cf-9f62-3578798e35ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:49.608683 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ba30557b-3a0c-44cf-9f62-3578798e35ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:49.627403 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ba30557b-3a0c-44cf-9f62-3578798e35ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:49.629093 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ba30557b-3a0c-44cf-9f62-3578798e35ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.625759 May 19 15:07:49.629905 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 116/234] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:49 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:07:49.645738 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-dd0adce6-9d79-4936-b9c4-9a0e9c566bb6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:49.647607 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-dd0adce6-9d79-4936-b9c4-9a0e9c566bb6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:49.656415 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-dd0adce6-9d79-4936-b9c4-9a0e9c566bb6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:49.657599 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-dd0adce6-9d79-4936-b9c4-9a0e9c566bb6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:49.658497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-dd0adce6-9d79-4936-b9c4-9a0e9c566bb6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:49.659189 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-dd0adce6-9d79-4936-b9c4-9a0e9c566bb6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:50.128071 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:07:50.133137 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:07:50.133704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:07:50.134469 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:07:50.135122 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:07:50.152998 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:50.154111 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:50.155133 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:50.155568 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-dd0adce6-9d79-4936-b9c4-9a0e9c566bb6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:50.158343 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:50.165944 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-dd0adce6-9d79-4936-b9c4-9a0e9c566bb6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd" status: 200 len: 1507 microversion: 2.1 time: 0.534502 May 19 15:07:50.166730 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 117/235] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:49 2022] GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd => generated 1507 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:50.182678 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-be9c4340-9ab3-48f2-aea8-03c92cc0b704 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:50.183626 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-be9c4340-9ab3-48f2-aea8-03c92cc0b704 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:50.191304 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for project 34c1099557144b8bb2fff88f5b526834. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:07:50.198028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-be9c4340-9ab3-48f2-aea8-03c92cc0b704 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:50.198860 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for user af7838e525a042dfa0357ad1fc58cf21 and project 34c1099557144b8bb2fff88f5b526834. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:07:50.202407 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-be9c4340-9ab3-48f2-aea8-03c92cc0b704 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:50.203447 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-be9c4340-9ab3-48f2-aea8-03c92cc0b704 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:50.204142 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-be9c4340-9ab3-48f2-aea8-03c92cc0b704 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:50.224312 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:07:50.227660 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:07:50.299263 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4eb6aa58-ec31-46e2-b2bf-88656584488a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.504483 May 19 15:07:50.300172 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 119/236] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:07:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:07:50.333382 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-913f718f-3682-4530-8254-a51db9305200 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:50.334689 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-913f718f-3682-4530-8254-a51db9305200 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:50.587026 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-913f718f-3682-4530-8254-a51db9305200 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:50.594297 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-913f718f-3682-4530-8254-a51db9305200 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1240 microversion: 2.1 time: 0.273329 May 19 15:07:50.597834 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 120/237] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:50 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1240 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:50.649230 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6335c66a-079b-4eaf-9491-961122110e68 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:50.650373 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6335c66a-079b-4eaf-9491-961122110e68 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:50.656795 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-be9c4340-9ab3-48f2-aea8-03c92cc0b704 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:50.668136 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6335c66a-079b-4eaf-9491-961122110e68 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:50.668595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6335c66a-079b-4eaf-9491-961122110e68 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:50.669387 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6335c66a-079b-4eaf-9491-961122110e68 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:50.669831 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6335c66a-079b-4eaf-9491-961122110e68 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:50.670458 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-be9c4340-9ab3-48f2-aea8-03c92cc0b704 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1371 microversion: 2.1 time: 0.496617 May 19 15:07:50.673681 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 118/238] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:50 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1371 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:51.109476 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6335c66a-079b-4eaf-9491-961122110e68 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:51.111996 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:51.123445 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6335c66a-079b-4eaf-9491-961122110e68 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:51.124954 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6335c66a-079b-4eaf-9491-961122110e68 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:51.126192 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6335c66a-079b-4eaf-9491-961122110e68 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.482422 May 19 15:07:51.133307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 121/239] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:50 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:07:51.612996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-010ea4e7-c2d6-4883-924e-78c3c29901e0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:51.613831 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-010ea4e7-c2d6-4883-924e-78c3c29901e0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:51.625948 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-010ea4e7-c2d6-4883-924e-78c3c29901e0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:51.627857 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-010ea4e7-c2d6-4883-924e-78c3c29901e0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:51.632684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-010ea4e7-c2d6-4883-924e-78c3c29901e0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:51.633272 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-010ea4e7-c2d6-4883-924e-78c3c29901e0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:51.694334 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8e382349-05f6-40d2-9642-77d63fccebe1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:51.694961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8e382349-05f6-40d2-9642-77d63fccebe1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:51.706144 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e382349-05f6-40d2-9642-77d63fccebe1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:51.706600 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e382349-05f6-40d2-9642-77d63fccebe1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:51.711511 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e382349-05f6-40d2-9642-77d63fccebe1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:51.712305 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e382349-05f6-40d2-9642-77d63fccebe1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:51.749252 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-010ea4e7-c2d6-4883-924e-78c3c29901e0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:51.763752 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-010ea4e7-c2d6-4883-924e-78c3c29901e0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1244 microversion: 2.1 time: 0.154970 May 19 15:07:51.770107 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 119/240] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:51 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1244 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:51.953383 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8e382349-05f6-40d2-9642-77d63fccebe1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:51.961091 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8e382349-05f6-40d2-9642-77d63fccebe1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1371 microversion: 2.1 time: 0.276003 May 19 15:07:51.961758 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 122/241] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:51 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:52.150660 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-8044baf2-5315-46ba-a597-1ae07049276e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:52.151497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-8044baf2-5315-46ba-a597-1ae07049276e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:52.158021 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8044baf2-5315-46ba-a597-1ae07049276e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:52.158486 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8044baf2-5315-46ba-a597-1ae07049276e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:52.159345 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8044baf2-5315-46ba-a597-1ae07049276e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:52.160548 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8044baf2-5315-46ba-a597-1ae07049276e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:52.659474 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8044baf2-5315-46ba-a597-1ae07049276e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:52.672776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8044baf2-5315-46ba-a597-1ae07049276e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:52.678704 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8044baf2-5315-46ba-a597-1ae07049276e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:52.680356 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-8044baf2-5315-46ba-a597-1ae07049276e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.534171 May 19 15:07:52.681504 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 120/242] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:52 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:07:52.784013 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d2a3d511-d207-4da4-9ecc-b88c2e917391 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:52.784642 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d2a3d511-d207-4da4-9ecc-b88c2e917391 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:52.794988 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d2a3d511-d207-4da4-9ecc-b88c2e917391 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:52.797494 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d2a3d511-d207-4da4-9ecc-b88c2e917391 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:52.811488 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d2a3d511-d207-4da4-9ecc-b88c2e917391 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:52.812610 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d2a3d511-d207-4da4-9ecc-b88c2e917391 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:52.924328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d2a3d511-d207-4da4-9ecc-b88c2e917391 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:52.936267 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d2a3d511-d207-4da4-9ecc-b88c2e917391 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1298 microversion: 2.1 time: 0.156642 May 19 15:07:52.938275 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 123/243] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:52 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1298 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:52.977131 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3c27a6b2-60ab-42bb-9e64-24f40aec2681 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:52.977809 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-3c27a6b2-60ab-42bb-9e64-24f40aec2681 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:52.987382 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3c27a6b2-60ab-42bb-9e64-24f40aec2681 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:52.987833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3c27a6b2-60ab-42bb-9e64-24f40aec2681 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:52.989406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3c27a6b2-60ab-42bb-9e64-24f40aec2681 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:52.991160 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3c27a6b2-60ab-42bb-9e64-24f40aec2681 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:53.288226 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-3c27a6b2-60ab-42bb-9e64-24f40aec2681 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:53.297913 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-3c27a6b2-60ab-42bb-9e64-24f40aec2681 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1371 microversion: 2.1 time: 0.324170 May 19 15:07:53.298821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 121/244] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:52 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1371 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:53.698293 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7d7cffa1-056a-4845-aee0-77b867610e4a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:53.698920 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7d7cffa1-056a-4845-aee0-77b867610e4a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:53.709495 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d7cffa1-056a-4845-aee0-77b867610e4a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:53.709988 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d7cffa1-056a-4845-aee0-77b867610e4a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:53.711330 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d7cffa1-056a-4845-aee0-77b867610e4a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:53.711984 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d7cffa1-056a-4845-aee0-77b867610e4a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:53.917711 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7d7cffa1-056a-4845-aee0-77b867610e4a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:53.928249 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7d7cffa1-056a-4845-aee0-77b867610e4a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:53.929736 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7d7cffa1-056a-4845-aee0-77b867610e4a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:53.931648 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7d7cffa1-056a-4845-aee0-77b867610e4a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.237656 May 19 15:07:53.932459 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 124/245] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:53 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:07:53.955175 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4bf66d7b-a6c3-4743-bdfd-d37faf0c2c16 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:53.956200 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4bf66d7b-a6c3-4743-bdfd-d37faf0c2c16 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:53.965157 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4bf66d7b-a6c3-4743-bdfd-d37faf0c2c16 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:53.966428 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4bf66d7b-a6c3-4743-bdfd-d37faf0c2c16 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:53.967744 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4bf66d7b-a6c3-4743-bdfd-d37faf0c2c16 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:53.968423 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4bf66d7b-a6c3-4743-bdfd-d37faf0c2c16 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:54.172573 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=2 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:54.197920 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4bf66d7b-a6c3-4743-bdfd-d37faf0c2c16 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:54.205017 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=12 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:54.207957 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4bf66d7b-a6c3-4743-bdfd-d37faf0c2c16 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1366 microversion: 2.1 time: 0.256666 May 19 15:07:54.209757 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 122/246] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:53 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:54.317318 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cddec45a-a83e-4a7b-875e-b691b8e095a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:54.326209 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cddec45a-a83e-4a7b-875e-b691b8e095a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:54.339763 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cddec45a-a83e-4a7b-875e-b691b8e095a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:54.340622 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cddec45a-a83e-4a7b-875e-b691b8e095a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:54.341626 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cddec45a-a83e-4a7b-875e-b691b8e095a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:54.342271 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cddec45a-a83e-4a7b-875e-b691b8e095a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:54.509812 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cddec45a-a83e-4a7b-875e-b691b8e095a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:54.519176 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cddec45a-a83e-4a7b-875e-b691b8e095a6 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1371 microversion: 2.1 time: 0.206409 May 19 15:07:54.529527 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 125/247] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:54 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:54.950686 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6d6f27e6-2fa7-4467-ba60-c974270a0f41 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:54.951344 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-6d6f27e6-2fa7-4467-ba60-c974270a0f41 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:54.957730 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6d6f27e6-2fa7-4467-ba60-c974270a0f41 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:54.958428 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6d6f27e6-2fa7-4467-ba60-c974270a0f41 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:54.959989 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6d6f27e6-2fa7-4467-ba60-c974270a0f41 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:54.960611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6d6f27e6-2fa7-4467-ba60-c974270a0f41 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:55.132114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6d6f27e6-2fa7-4467-ba60-c974270a0f41 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:55.143679 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6d6f27e6-2fa7-4467-ba60-c974270a0f41 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:55.150612 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6d6f27e6-2fa7-4467-ba60-c974270a0f41 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:55.153088 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6d6f27e6-2fa7-4467-ba60-c974270a0f41 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.206916 May 19 15:07:55.154135 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 123/248] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:54 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:07:55.228902 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-efb9afa4-c395-4af9-a55d-062c93f2220f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:55.230135 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-efb9afa4-c395-4af9-a55d-062c93f2220f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:55.243937 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-efb9afa4-c395-4af9-a55d-062c93f2220f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:55.244708 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-efb9afa4-c395-4af9-a55d-062c93f2220f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:55.246109 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-efb9afa4-c395-4af9-a55d-062c93f2220f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:55.246706 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-efb9afa4-c395-4af9-a55d-062c93f2220f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:55.435089 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-740fac8d-1e68-42e6-baca-0b453612b8c3 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Action: 'create', calling method: .version_select at 0x7f35d15a0e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1235658748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG3L1xBpjc5jvml40yxHTzAnoaUW24yU2ZEzvqFsE+PeMovuPvHHaZtvKF5nCDT0lvNt0ys0qtdktng430Togm8TYSGCDqi32XBoHxeOnfdMYfZq2ajiykmVZv0+HCSPw=="}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:55.457287 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-740fac8d-1e68-42e6-baca-0b453612b8c3 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Getting quotas for project 2c71bc8f0a164884bc0c046fd1e7faab. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:07:55.475189 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-efb9afa4-c395-4af9-a55d-062c93f2220f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:55.481812 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-740fac8d-1e68-42e6-baca-0b453612b8c3 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Getting quotas for user 9877b9bbc14141bba21625fc8f1046d2 and project 2c71bc8f0a164884bc0c046fd1e7faab. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:07:55.490531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-efb9afa4-c395-4af9-a55d-062c93f2220f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1366 microversion: 2.1 time: 0.264435 May 19 15:07:55.493322 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 124/249] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:55 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:55.494857 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:55.503723 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-54429c75-fa95-4311-915b-7d70a1f7c30e req-6ea36f09-9e4b-4d2c-834f-ccbfb850860b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b9c3778-68d3-440a-b89c-22cf3a93baca", "tag": "a54c0604-314a-4a3c-a1e0-e03eb78af1d6"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:55.520485 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-54429c75-fa95-4311-915b-7d70a1f7c30e req-6ea36f09-9e4b-4d2c-834f-ccbfb850860b service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:55.521954 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-54429c75-fa95-4311-915b-7d70a1f7c30e req-6ea36f09-9e4b-4d2c-834f-ccbfb850860b service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:55.541778 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-740fac8d-1e68-42e6-baca-0b453612b8c3 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.494814 May 19 15:07:55.542259 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-54429c75-fa95-4311-915b-7d70a1f7c30e req-6ea36f09-9e4b-4d2c-834f-ccbfb850860b service nova] Creating event network-changed:a54c0604-314a-4a3c-a1e0-e03eb78af1d6 for instance 2b9c3778-68d3-440a-b89c-22cf3a93baca on hv-cinder-82549 May 19 15:07:55.542774 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 126/250] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 15:07:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:07:55.548611 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e09d5ef3-2dad-4b0c-b52f-cec440bb6c73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:55.549382 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e09d5ef3-2dad-4b0c-b52f-cec440bb6c73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:55.557146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-54429c75-fa95-4311-915b-7d70a1f7c30e req-6ea36f09-9e4b-4d2c-834f-ccbfb850860b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060407 May 19 15:07:55.558747 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 125/251] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:07:55.567699 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e09d5ef3-2dad-4b0c-b52f-cec440bb6c73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:55.567699 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e09d5ef3-2dad-4b0c-b52f-cec440bb6c73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:55.567699 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e09d5ef3-2dad-4b0c-b52f-cec440bb6c73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:55.567699 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e09d5ef3-2dad-4b0c-b52f-cec440bb6c73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:55.794219 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e09d5ef3-2dad-4b0c-b52f-cec440bb6c73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:55.794365 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-42d29a8e-5a51-49eb-bbcd-bebb0b785332 req-ee3167dc-3435-4f04-a712-6168caf3b4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b30b6fd-1ba9-4939-baeb-d0fb305b1176", "name": "network-vif-plugged", "status": "completed", "tag": "7377972f-e26c-43d1-ac62-ddf4b52e4bfd"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:07:55.803300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e09d5ef3-2dad-4b0c-b52f-cec440bb6c73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1371 microversion: 2.1 time: 0.258484 May 19 15:07:55.804117 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 127/252] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:55 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:55.809249 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-42d29a8e-5a51-49eb-bbcd-bebb0b785332 req-ee3167dc-3435-4f04-a712-6168caf3b4aa service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:55.809740 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-42d29a8e-5a51-49eb-bbcd-bebb0b785332 req-ee3167dc-3435-4f04-a712-6168caf3b4aa service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:55.823306 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-42d29a8e-5a51-49eb-bbcd-bebb0b785332 req-ee3167dc-3435-4f04-a712-6168caf3b4aa service nova] Creating event network-vif-plugged:7377972f-e26c-43d1-ac62-ddf4b52e4bfd for instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 on hv-cinder-82549 May 19 15:07:55.831594 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-42d29a8e-5a51-49eb-bbcd-bebb0b785332 req-ee3167dc-3435-4f04-a712-6168caf3b4aa service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041696 May 19 15:07:55.834122 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 126/253] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:07:56.171878 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9b882da1-e248-44f5-b086-f90dc354d35f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:56.172589 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9b882da1-e248-44f5-b086-f90dc354d35f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:56.180182 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9b882da1-e248-44f5-b086-f90dc354d35f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:56.180642 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9b882da1-e248-44f5-b086-f90dc354d35f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:56.181591 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9b882da1-e248-44f5-b086-f90dc354d35f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:56.182202 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9b882da1-e248-44f5-b086-f90dc354d35f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:56.367471 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9b882da1-e248-44f5-b086-f90dc354d35f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:56.389218 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9b882da1-e248-44f5-b086-f90dc354d35f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:56.391081 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9b882da1-e248-44f5-b086-f90dc354d35f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:56.392398 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9b882da1-e248-44f5-b086-f90dc354d35f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.224682 May 19 15:07:56.393324 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 128/254] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:56 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:07:56.511807 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-500a341d-0427-4668-889e-9fcd27f90b9b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:56.513151 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-500a341d-0427-4668-889e-9fcd27f90b9b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:56.520586 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-500a341d-0427-4668-889e-9fcd27f90b9b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:56.521853 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-500a341d-0427-4668-889e-9fcd27f90b9b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:56.522902 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-500a341d-0427-4668-889e-9fcd27f90b9b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:56.523533 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-500a341d-0427-4668-889e-9fcd27f90b9b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:56.687824 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-500a341d-0427-4668-889e-9fcd27f90b9b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:56.714658 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-500a341d-0427-4668-889e-9fcd27f90b9b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1366 microversion: 2.1 time: 0.197021 May 19 15:07:56.724998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 127/255] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:56 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:56.821273 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9d690852-8042-45ed-9274-8bbc72f5c45a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:56.822062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9d690852-8042-45ed-9274-8bbc72f5c45a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:56.833028 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9d690852-8042-45ed-9274-8bbc72f5c45a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:56.833958 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9d690852-8042-45ed-9274-8bbc72f5c45a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:56.835515 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9d690852-8042-45ed-9274-8bbc72f5c45a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:56.836105 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9d690852-8042-45ed-9274-8bbc72f5c45a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:57.035916 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9d690852-8042-45ed-9274-8bbc72f5c45a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:57.048093 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9d690852-8042-45ed-9274-8bbc72f5c45a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1371 microversion: 2.1 time: 0.231966 May 19 15:07:57.048839 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 129/256] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:56 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:57.425404 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-8bbc23aa-df6a-411d-bc3c-c1499976079f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:57.426094 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-8bbc23aa-df6a-411d-bc3c-c1499976079f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:57.436647 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8bbc23aa-df6a-411d-bc3c-c1499976079f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:57.438013 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8bbc23aa-df6a-411d-bc3c-c1499976079f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:57.440424 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8bbc23aa-df6a-411d-bc3c-c1499976079f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:57.441359 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8bbc23aa-df6a-411d-bc3c-c1499976079f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:57.615877 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8bbc23aa-df6a-411d-bc3c-c1499976079f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:57.627853 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8bbc23aa-df6a-411d-bc3c-c1499976079f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:57.630490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8bbc23aa-df6a-411d-bc3c-c1499976079f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:57.632366 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-8bbc23aa-df6a-411d-bc3c-c1499976079f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.224753 May 19 15:07:57.644436 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 128/257] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:57 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:07:57.732357 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5a4c35a5-12fc-4fe3-a7c7-fef79f483d13 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:57.733043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5a4c35a5-12fc-4fe3-a7c7-fef79f483d13 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:57.740238 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5a4c35a5-12fc-4fe3-a7c7-fef79f483d13 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:57.740688 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5a4c35a5-12fc-4fe3-a7c7-fef79f483d13 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:57.741451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5a4c35a5-12fc-4fe3-a7c7-fef79f483d13 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:57.741898 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5a4c35a5-12fc-4fe3-a7c7-fef79f483d13 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:57.896167 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5a4c35a5-12fc-4fe3-a7c7-fef79f483d13 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:57.903983 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5a4c35a5-12fc-4fe3-a7c7-fef79f483d13 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1366 microversion: 2.1 time: 0.175734 May 19 15:07:57.904566 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 130/258] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:57 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:58.066102 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a1e4778c-fa11-47ef-932d-9f02c46405eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:58.066976 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-a1e4778c-fa11-47ef-932d-9f02c46405eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:58.073346 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a1e4778c-fa11-47ef-932d-9f02c46405eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:58.073900 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a1e4778c-fa11-47ef-932d-9f02c46405eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:58.074863 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a1e4778c-fa11-47ef-932d-9f02c46405eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:58.075583 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a1e4778c-fa11-47ef-932d-9f02c46405eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:58.080020 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=100 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:07:58.232061 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-a1e4778c-fa11-47ef-932d-9f02c46405eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:58.240020 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-a1e4778c-fa11-47ef-932d-9f02c46405eb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1371 microversion: 2.1 time: 0.178514 May 19 15:07:58.241275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 129/259] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:58 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:58.650979 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-054cab59-ceaf-4b1d-8f3f-aa79475f39c5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:58.651789 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-054cab59-ceaf-4b1d-8f3f-aa79475f39c5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:58.658024 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-054cab59-ceaf-4b1d-8f3f-aa79475f39c5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:58.658480 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-054cab59-ceaf-4b1d-8f3f-aa79475f39c5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:58.659278 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-054cab59-ceaf-4b1d-8f3f-aa79475f39c5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:58.659718 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-054cab59-ceaf-4b1d-8f3f-aa79475f39c5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:58.798573 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-054cab59-ceaf-4b1d-8f3f-aa79475f39c5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:58.807788 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-054cab59-ceaf-4b1d-8f3f-aa79475f39c5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:58.809306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-054cab59-ceaf-4b1d-8f3f-aa79475f39c5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:58.810487 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-054cab59-ceaf-4b1d-8f3f-aa79475f39c5 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.163453 May 19 15:07:58.811053 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 131/260] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:58 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:07:58.921633 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7173c12e-de29-405c-b7d1-8a7e43475cde tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:58.922238 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7173c12e-de29-405c-b7d1-8a7e43475cde tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:58.930158 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7173c12e-de29-405c-b7d1-8a7e43475cde tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:58.930603 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7173c12e-de29-405c-b7d1-8a7e43475cde tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:58.931393 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7173c12e-de29-405c-b7d1-8a7e43475cde tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:58.931824 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7173c12e-de29-405c-b7d1-8a7e43475cde tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:59.063575 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7173c12e-de29-405c-b7d1-8a7e43475cde tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:59.072012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7173c12e-de29-405c-b7d1-8a7e43475cde tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1366 microversion: 2.1 time: 0.154477 May 19 15:07:59.072659 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 130/261] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:58 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:59.257757 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9e4da5c4-c5f1-430e-a842-fbc9c40a7b99 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:59.258372 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9e4da5c4-c5f1-430e-a842-fbc9c40a7b99 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:59.264483 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9e4da5c4-c5f1-430e-a842-fbc9c40a7b99 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:59.264880 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9e4da5c4-c5f1-430e-a842-fbc9c40a7b99 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:59.265653 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9e4da5c4-c5f1-430e-a842-fbc9c40a7b99 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:59.266097 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9e4da5c4-c5f1-430e-a842-fbc9c40a7b99 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:59.410240 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9e4da5c4-c5f1-430e-a842-fbc9c40a7b99 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:59.418573 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9e4da5c4-c5f1-430e-a842-fbc9c40a7b99 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1371 microversion: 2.1 time: 0.164718 May 19 15:07:59.419153 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 132/262] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:07:59 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:07:59.829734 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9f5380a5-2732-40ab-8b1f-28422ba72e0f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:07:59.830742 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-9f5380a5-2732-40ab-8b1f-28422ba72e0f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:07:59.838377 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9f5380a5-2732-40ab-8b1f-28422ba72e0f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:59.838843 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9f5380a5-2732-40ab-8b1f-28422ba72e0f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:59.839722 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9f5380a5-2732-40ab-8b1f-28422ba72e0f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:07:59.840340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9f5380a5-2732-40ab-8b1f-28422ba72e0f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:07:59.974717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9f5380a5-2732-40ab-8b1f-28422ba72e0f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:59.983095 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9f5380a5-2732-40ab-8b1f-28422ba72e0f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:59.986589 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9f5380a5-2732-40ab-8b1f-28422ba72e0f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:07:59.987969 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9f5380a5-2732-40ab-8b1f-28422ba72e0f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1744 microversion: 2.20 time: 0.162855 May 19 15:07:59.988580 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 131/263] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:07:59 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:00.089588 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-da1e18b2-4ab6-4075-a1de-30ad55dbdf19 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:00.090100 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-da1e18b2-4ab6-4075-a1de-30ad55dbdf19 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:00.097127 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-da1e18b2-4ab6-4075-a1de-30ad55dbdf19 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:00.097629 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-da1e18b2-4ab6-4075-a1de-30ad55dbdf19 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:00.098533 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-da1e18b2-4ab6-4075-a1de-30ad55dbdf19 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:00.099111 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-da1e18b2-4ab6-4075-a1de-30ad55dbdf19 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:00.176081 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:00.229738 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-da1e18b2-4ab6-4075-a1de-30ad55dbdf19 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:00.237163 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-da1e18b2-4ab6-4075-a1de-30ad55dbdf19 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1366 microversion: 2.1 time: 0.151562 May 19 15:08:00.237727 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 133/264] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:00 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:00.436111 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3d9d5e9c-2c2b-42d6-9601-fef1632c98b8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:00.436714 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-3d9d5e9c-2c2b-42d6-9601-fef1632c98b8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:00.443583 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3d9d5e9c-2c2b-42d6-9601-fef1632c98b8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:00.444077 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3d9d5e9c-2c2b-42d6-9601-fef1632c98b8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:00.444849 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3d9d5e9c-2c2b-42d6-9601-fef1632c98b8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:00.445288 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3d9d5e9c-2c2b-42d6-9601-fef1632c98b8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:00.582323 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-3d9d5e9c-2c2b-42d6-9601-fef1632c98b8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:00.589708 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-3d9d5e9c-2c2b-42d6-9601-fef1632c98b8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1564 microversion: 2.1 time: 0.157480 May 19 15:08:00.590263 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 132/265] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:00 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:00.605754 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3bad5a24-b313-4f15-b3a1-a6b6645c1478 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:00.606319 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3bad5a24-b313-4f15-b3a1-a6b6645c1478 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:00.613706 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3bad5a24-b313-4f15-b3a1-a6b6645c1478 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:00.614160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3bad5a24-b313-4f15-b3a1-a6b6645c1478 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:00.615460 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3bad5a24-b313-4f15-b3a1-a6b6645c1478 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:00.615903 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3bad5a24-b313-4f15-b3a1-a6b6645c1478 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:00.702772 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3bad5a24-b313-4f15-b3a1-a6b6645c1478 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100923 May 19 15:08:00.704386 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 134/266] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 15:08:00 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:08:01.006145 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-99b66e98-ec45-4c42-b520-2749fb519765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:01.006758 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-99b66e98-ec45-4c42-b520-2749fb519765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:01.013299 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-99b66e98-ec45-4c42-b520-2749fb519765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:01.014062 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-99b66e98-ec45-4c42-b520-2749fb519765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:01.014837 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-99b66e98-ec45-4c42-b520-2749fb519765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:01.015305 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-99b66e98-ec45-4c42-b520-2749fb519765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:01.254554 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e053d032-1081-4a89-9c00-c6229efc2b3d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:01.255500 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e053d032-1081-4a89-9c00-c6229efc2b3d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:01.262584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e053d032-1081-4a89-9c00-c6229efc2b3d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:01.263041 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e053d032-1081-4a89-9c00-c6229efc2b3d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:01.264422 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e053d032-1081-4a89-9c00-c6229efc2b3d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:01.264865 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e053d032-1081-4a89-9c00-c6229efc2b3d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:01.401973 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-99b66e98-ec45-4c42-b520-2749fb519765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:01.411394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-99b66e98-ec45-4c42-b520-2749fb519765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:01.413768 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-99b66e98-ec45-4c42-b520-2749fb519765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:01.415113 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-99b66e98-ec45-4c42-b520-2749fb519765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1744 microversion: 2.20 time: 0.413022 May 19 15:08:01.415716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 133/267] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:01 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1744 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:01.420445 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-8f02569d-0a01-4dda-8134-4bbcc73ffa9b req-699b4d56-6e4d-4443-9186-8f91295953a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6324753a-5912-42c2-a1f4-0bc631bea605", "name": "network-vif-plugged", "status": "completed", "tag": "3beaa750-59c9-4ce6-b188-390d70f3fb7a"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:08:01.429067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-8f02569d-0a01-4dda-8134-4bbcc73ffa9b req-699b4d56-6e4d-4443-9186-8f91295953a8 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:01.429506 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-8f02569d-0a01-4dda-8134-4bbcc73ffa9b req-699b4d56-6e4d-4443-9186-8f91295953a8 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:01.441093 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-8f02569d-0a01-4dda-8134-4bbcc73ffa9b req-699b4d56-6e4d-4443-9186-8f91295953a8 service nova] Creating event network-vif-plugged:3beaa750-59c9-4ce6-b188-390d70f3fb7a for instance 6324753a-5912-42c2-a1f4-0bc631bea605 on hv-cinder-82549 May 19 15:08:01.446010 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-8f02569d-0a01-4dda-8134-4bbcc73ffa9b req-699b4d56-6e4d-4443-9186-8f91295953a8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029010 May 19 15:08:01.446756 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 134/268] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:08:01.594363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e053d032-1081-4a89-9c00-c6229efc2b3d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:01.602102 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e053d032-1081-4a89-9c00-c6229efc2b3d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1366 microversion: 2.1 time: 0.351762 May 19 15:08:01.602675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 135/269] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:01 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:08:02.266084 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-ce695fa2-9c4a-4dba-9ce6-170fb4b81c1b req-9f0fc6a6-3342-4fd2-98c7-8a9111ee264d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b30b6fd-1ba9-4939-baeb-d0fb305b1176", "tag": "7377972f-e26c-43d1-ac62-ddf4b52e4bfd"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:08:02.270229 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:02.279299 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-ce695fa2-9c4a-4dba-9ce6-170fb4b81c1b req-9f0fc6a6-3342-4fd2-98c7-8a9111ee264d service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:02.279865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-ce695fa2-9c4a-4dba-9ce6-170fb4b81c1b req-9f0fc6a6-3342-4fd2-98c7-8a9111ee264d service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:02.292150 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-ce695fa2-9c4a-4dba-9ce6-170fb4b81c1b req-9f0fc6a6-3342-4fd2-98c7-8a9111ee264d service nova] Creating event network-changed:7377972f-e26c-43d1-ac62-ddf4b52e4bfd for instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 on hv-cinder-82549 May 19 15:08:02.297005 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-ce695fa2-9c4a-4dba-9ce6-170fb4b81c1b req-9f0fc6a6-3342-4fd2-98c7-8a9111ee264d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035435 May 19 15:08:02.297844 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 135/270] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:08:02.439849 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-75fe3871-3296-484f-a72e-110d2de7f765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:02.442103 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-75fe3871-3296-484f-a72e-110d2de7f765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:02.454198 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75fe3871-3296-484f-a72e-110d2de7f765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:02.455154 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75fe3871-3296-484f-a72e-110d2de7f765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:02.456209 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75fe3871-3296-484f-a72e-110d2de7f765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:02.456828 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-75fe3871-3296-484f-a72e-110d2de7f765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:02.607610 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-75fe3871-3296-484f-a72e-110d2de7f765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:02.617184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-75fe3871-3296-484f-a72e-110d2de7f765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:02.619228 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-75fe3871-3296-484f-a72e-110d2de7f765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:02.620665 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-cc0e03a8-5be9-41dc-adb8-54dc74018814 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:02.621351 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-75fe3871-3296-484f-a72e-110d2de7f765 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1739 microversion: 2.20 time: 0.189105 May 19 15:08:02.621919 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-cc0e03a8-5be9-41dc-adb8-54dc74018814 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:02.624095 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 136/271] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:02 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:02.632451 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cc0e03a8-5be9-41dc-adb8-54dc74018814 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:02.633619 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cc0e03a8-5be9-41dc-adb8-54dc74018814 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:02.634879 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cc0e03a8-5be9-41dc-adb8-54dc74018814 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:02.635502 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cc0e03a8-5be9-41dc-adb8-54dc74018814 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:02.793295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-cc0e03a8-5be9-41dc-adb8-54dc74018814 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:02.801377 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-cc0e03a8-5be9-41dc-adb8-54dc74018814 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1366 microversion: 2.1 time: 0.186801 May 19 15:08:02.801963 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 136/272] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:02 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:08:03.641590 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-592e023b-0d3f-493c-9344-9a8430d3a321 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:03.642205 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-592e023b-0d3f-493c-9344-9a8430d3a321 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:03.648806 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-592e023b-0d3f-493c-9344-9a8430d3a321 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:03.649303 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-592e023b-0d3f-493c-9344-9a8430d3a321 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:03.650138 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-592e023b-0d3f-493c-9344-9a8430d3a321 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:03.650582 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-592e023b-0d3f-493c-9344-9a8430d3a321 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:03.844996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f7c697cd-0277-4810-bdc0-c56f8d6a1c1d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:03.845626 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f7c697cd-0277-4810-bdc0-c56f8d6a1c1d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:03.846202 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-592e023b-0d3f-493c-9344-9a8430d3a321 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:03.886411 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7c697cd-0277-4810-bdc0-c56f8d6a1c1d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:03.886873 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7c697cd-0277-4810-bdc0-c56f8d6a1c1d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:03.887689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7c697cd-0277-4810-bdc0-c56f8d6a1c1d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:03.888300 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7c697cd-0277-4810-bdc0-c56f8d6a1c1d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:03.889073 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-592e023b-0d3f-493c-9344-9a8430d3a321 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:03.890732 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-592e023b-0d3f-493c-9344-9a8430d3a321 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:03.892543 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-592e023b-0d3f-493c-9344-9a8430d3a321 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1739 microversion: 2.20 time: 0.254486 May 19 15:08:03.898322 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 137/273] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:03 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:04.083279 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f7c697cd-0277-4810-bdc0-c56f8d6a1c1d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:04.091385 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f7c697cd-0277-4810-bdc0-c56f8d6a1c1d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1366 microversion: 2.1 time: 0.270604 May 19 15:08:04.092314 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 137/274] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:03 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:04.912607 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b7d6d858-d74f-4c5f-9ea9-4c96c628cb84 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:04.913277 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b7d6d858-d74f-4c5f-9ea9-4c96c628cb84 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:04.919785 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7d6d858-d74f-4c5f-9ea9-4c96c628cb84 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:04.920240 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7d6d858-d74f-4c5f-9ea9-4c96c628cb84 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:04.921020 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7d6d858-d74f-4c5f-9ea9-4c96c628cb84 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:04.921462 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7d6d858-d74f-4c5f-9ea9-4c96c628cb84 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:05.060283 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b7d6d858-d74f-4c5f-9ea9-4c96c628cb84 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:05.068206 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b7d6d858-d74f-4c5f-9ea9-4c96c628cb84 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:05.069720 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b7d6d858-d74f-4c5f-9ea9-4c96c628cb84 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:05.070881 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b7d6d858-d74f-4c5f-9ea9-4c96c628cb84 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1739 microversion: 2.20 time: 0.162999 May 19 15:08:05.071483 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 138/275] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:04 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:05.109462 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-924cbec0-1e4a-4929-b6d3-d93dca298ef0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:05.110075 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-924cbec0-1e4a-4929-b6d3-d93dca298ef0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:05.116685 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-924cbec0-1e4a-4929-b6d3-d93dca298ef0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:05.117197 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-924cbec0-1e4a-4929-b6d3-d93dca298ef0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:05.118163 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-924cbec0-1e4a-4929-b6d3-d93dca298ef0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:05.118526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-924cbec0-1e4a-4929-b6d3-d93dca298ef0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:05.248636 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-924cbec0-1e4a-4929-b6d3-d93dca298ef0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:05.256093 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-924cbec0-1e4a-4929-b6d3-d93dca298ef0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1366 microversion: 2.1 time: 0.150614 May 19 15:08:05.256668 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 138/276] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:05 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:05.405755 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-0159fffe-93bd-4b26-8d6a-b6b7f0db1438 req-ba651880-19a7-4322-80cd-dce5c6381336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9c3778-68d3-440a-b89c-22cf3a93baca", "name": "network-vif-plugged", "status": "completed", "tag": "a54c0604-314a-4a3c-a1e0-e03eb78af1d6"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:08:05.420300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-0159fffe-93bd-4b26-8d6a-b6b7f0db1438 req-ba651880-19a7-4322-80cd-dce5c6381336 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:05.420789 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-0159fffe-93bd-4b26-8d6a-b6b7f0db1438 req-ba651880-19a7-4322-80cd-dce5c6381336 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:05.432390 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-0159fffe-93bd-4b26-8d6a-b6b7f0db1438 req-ba651880-19a7-4322-80cd-dce5c6381336 service nova] Creating event network-vif-plugged:a54c0604-314a-4a3c-a1e0-e03eb78af1d6 for instance 2b9c3778-68d3-440a-b89c-22cf3a93baca on hv-cinder-82549 May 19 15:08:05.437792 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-0159fffe-93bd-4b26-8d6a-b6b7f0db1438 req-ba651880-19a7-4322-80cd-dce5c6381336 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036821 May 19 15:08:05.438410 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 139/277] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:08:06.090169 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6a48f7ce-0324-4cee-9f5a-f0e1faa3a3af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:06.092801 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-6a48f7ce-0324-4cee-9f5a-f0e1faa3a3af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:06.101712 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6a48f7ce-0324-4cee-9f5a-f0e1faa3a3af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:06.102422 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6a48f7ce-0324-4cee-9f5a-f0e1faa3a3af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:06.103561 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6a48f7ce-0324-4cee-9f5a-f0e1faa3a3af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:06.104206 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6a48f7ce-0324-4cee-9f5a-f0e1faa3a3af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:06.253079 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6a48f7ce-0324-4cee-9f5a-f0e1faa3a3af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:06.262677 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6a48f7ce-0324-4cee-9f5a-f0e1faa3a3af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:06.264442 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6a48f7ce-0324-4cee-9f5a-f0e1faa3a3af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:06.267314 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6a48f7ce-0324-4cee-9f5a-f0e1faa3a3af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1739 microversion: 2.20 time: 0.179667 May 19 15:08:06.270811 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=24 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:06.280496 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 139/278] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:06 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:06.284295 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-592f3d31-48b5-4a49-a014-833d0c911922 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:06.285229 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-592f3d31-48b5-4a49-a014-833d0c911922 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:06.293547 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-592f3d31-48b5-4a49-a014-833d0c911922 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:06.294005 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-592f3d31-48b5-4a49-a014-833d0c911922 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:06.294816 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-592f3d31-48b5-4a49-a014-833d0c911922 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:06.295333 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-592f3d31-48b5-4a49-a014-833d0c911922 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:06.324760 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=100 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:06.472242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-592f3d31-48b5-4a49-a014-833d0c911922 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:06.480617 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-592f3d31-48b5-4a49-a014-833d0c911922 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1366 microversion: 2.1 time: 0.210785 May 19 15:08:06.481413 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 140/279] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:06 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:08:07.287985 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-df53011c-352e-49d7-ad37-62587b07c07a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:07.289457 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-df53011c-352e-49d7-ad37-62587b07c07a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:07.300470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-df53011c-352e-49d7-ad37-62587b07c07a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:07.307787 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-df53011c-352e-49d7-ad37-62587b07c07a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:07.308793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-df53011c-352e-49d7-ad37-62587b07c07a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:07.309307 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-df53011c-352e-49d7-ad37-62587b07c07a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:07.473838 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-df53011c-352e-49d7-ad37-62587b07c07a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:07.484879 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-df53011c-352e-49d7-ad37-62587b07c07a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:07.489270 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-df53011c-352e-49d7-ad37-62587b07c07a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:07.491030 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-df53011c-352e-49d7-ad37-62587b07c07a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1739 microversion: 2.20 time: 0.207268 May 19 15:08:07.491953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 140/280] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:07 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:07.497824 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a53fa3f8-a06f-4ba5-b0d5-86e9672fa066 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:07.498584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a53fa3f8-a06f-4ba5-b0d5-86e9672fa066 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:07.510887 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a53fa3f8-a06f-4ba5-b0d5-86e9672fa066 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:07.511453 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a53fa3f8-a06f-4ba5-b0d5-86e9672fa066 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:07.512359 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a53fa3f8-a06f-4ba5-b0d5-86e9672fa066 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:07.512902 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a53fa3f8-a06f-4ba5-b0d5-86e9672fa066 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:07.696775 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a53fa3f8-a06f-4ba5-b0d5-86e9672fa066 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:07.705617 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a53fa3f8-a06f-4ba5-b0d5-86e9672fa066 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1555 microversion: 2.1 time: 0.211661 May 19 15:08:07.706738 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 141/281] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:07 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1555 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:07.726082 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e66e2baa-425b-457e-9480-f1c4ef40b7f2 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:07.726975 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e66e2baa-425b-457e-9480-f1c4ef40b7f2 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:07.736739 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e66e2baa-425b-457e-9480-f1c4ef40b7f2 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:07.738039 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e66e2baa-425b-457e-9480-f1c4ef40b7f2 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:07.738896 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e66e2baa-425b-457e-9480-f1c4ef40b7f2 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:07.739445 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e66e2baa-425b-457e-9480-f1c4ef40b7f2 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:07.829017 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e66e2baa-425b-457e-9480-f1c4ef40b7f2 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107773 May 19 15:08:07.829609 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 141/282] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 15:08:07 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:08:08.512299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-34705084-be78-44f1-bf59-e53890186115 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:08.513134 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-34705084-be78-44f1-bf59-e53890186115 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:08.519837 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-34705084-be78-44f1-bf59-e53890186115 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:08.521168 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-34705084-be78-44f1-bf59-e53890186115 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:08.521999 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-34705084-be78-44f1-bf59-e53890186115 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:08.522514 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-34705084-be78-44f1-bf59-e53890186115 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:08.794282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-34705084-be78-44f1-bf59-e53890186115 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:08.806637 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-34705084-be78-44f1-bf59-e53890186115 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:08.808177 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-34705084-be78-44f1-bf59-e53890186115 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:08.809638 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-34705084-be78-44f1-bf59-e53890186115 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1739 microversion: 2.20 time: 0.301390 May 19 15:08:08.822757 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 142/283] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:08 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:08.981663 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-9f4478bd-b62a-44a4-b266-aac281995c17 req-410c386e-b350-445a-b15b-9c69935830e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b9c3778-68d3-440a-b89c-22cf3a93baca", "tag": "a54c0604-314a-4a3c-a1e0-e03eb78af1d6"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:08:08.990603 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-9f4478bd-b62a-44a4-b266-aac281995c17 req-410c386e-b350-445a-b15b-9c69935830e0 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:08.991435 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-9f4478bd-b62a-44a4-b266-aac281995c17 req-410c386e-b350-445a-b15b-9c69935830e0 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:09.003999 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-9f4478bd-b62a-44a4-b266-aac281995c17 req-410c386e-b350-445a-b15b-9c69935830e0 service nova] Creating event network-changed:a54c0604-314a-4a3c-a1e0-e03eb78af1d6 for instance 2b9c3778-68d3-440a-b89c-22cf3a93baca on hv-cinder-82549 May 19 15:08:09.009482 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-9f4478bd-b62a-44a4-b266-aac281995c17 req-410c386e-b350-445a-b15b-9c69935830e0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031365 May 19 15:08:09.010742 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 142/284] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:08:09.831804 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c7025aae-e478-40a9-9520-ef88e47f4569 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:09.832434 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c7025aae-e478-40a9-9520-ef88e47f4569 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:09.844555 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7025aae-e478-40a9-9520-ef88e47f4569 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:09.845019 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7025aae-e478-40a9-9520-ef88e47f4569 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:09.845808 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7025aae-e478-40a9-9520-ef88e47f4569 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:09.846248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c7025aae-e478-40a9-9520-ef88e47f4569 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:10.081418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c7025aae-e478-40a9-9520-ef88e47f4569 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:10.095349 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c7025aae-e478-40a9-9520-ef88e47f4569 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:10.098890 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c7025aae-e478-40a9-9520-ef88e47f4569 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:10.100404 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c7025aae-e478-40a9-9520-ef88e47f4569 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1739 microversion: 2.20 time: 0.274498 May 19 15:08:10.101209 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 143/285] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:09 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:11.121506 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-5b0ce70d-031e-44fe-a20d-8f4c7e35b19d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:11.123090 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-5b0ce70d-031e-44fe-a20d-8f4c7e35b19d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:11.130845 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5b0ce70d-031e-44fe-a20d-8f4c7e35b19d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:11.131433 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5b0ce70d-031e-44fe-a20d-8f4c7e35b19d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:11.132121 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5b0ce70d-031e-44fe-a20d-8f4c7e35b19d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:11.132537 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5b0ce70d-031e-44fe-a20d-8f4c7e35b19d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:11.299680 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5b0ce70d-031e-44fe-a20d-8f4c7e35b19d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:11.309123 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5b0ce70d-031e-44fe-a20d-8f4c7e35b19d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:11.312370 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5b0ce70d-031e-44fe-a20d-8f4c7e35b19d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:11.313618 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-5b0ce70d-031e-44fe-a20d-8f4c7e35b19d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1739 microversion: 2.20 time: 0.197731 May 19 15:08:11.339228 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 143/286] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:11 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:12.342866 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-696ca469-2b17-4971-b5a2-57f18d59daad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:12.343595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-696ca469-2b17-4971-b5a2-57f18d59daad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:12.350202 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-696ca469-2b17-4971-b5a2-57f18d59daad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:12.350938 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-696ca469-2b17-4971-b5a2-57f18d59daad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:12.352759 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-696ca469-2b17-4971-b5a2-57f18d59daad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:12.353333 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-696ca469-2b17-4971-b5a2-57f18d59daad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:12.506799 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-696ca469-2b17-4971-b5a2-57f18d59daad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:12.515707 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-696ca469-2b17-4971-b5a2-57f18d59daad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:12.517649 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-696ca469-2b17-4971-b5a2-57f18d59daad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:12.518825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-696ca469-2b17-4971-b5a2-57f18d59daad tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1739 microversion: 2.20 time: 0.182501 May 19 15:08:12.519944 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 144/287] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:12 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:13.537618 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7347c486-8008-4079-bd21-46b9c6aeb601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:13.538867 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7347c486-8008-4079-bd21-46b9c6aeb601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:13.545941 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7347c486-8008-4079-bd21-46b9c6aeb601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:13.546630 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7347c486-8008-4079-bd21-46b9c6aeb601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:13.547615 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7347c486-8008-4079-bd21-46b9c6aeb601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:13.548055 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7347c486-8008-4079-bd21-46b9c6aeb601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:13.702764 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7347c486-8008-4079-bd21-46b9c6aeb601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:13.711770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7347c486-8008-4079-bd21-46b9c6aeb601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:13.713520 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7347c486-8008-4079-bd21-46b9c6aeb601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:13.717073 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7347c486-8008-4079-bd21-46b9c6aeb601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1739 microversion: 2.20 time: 0.184001 May 19 15:08:13.717890 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 144/288] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:13 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:08:14.735662 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-73890d66-3a0b-46fa-9f64-4cfda228ea10 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:14.736959 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-73890d66-3a0b-46fa-9f64-4cfda228ea10 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:14.744278 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-73890d66-3a0b-46fa-9f64-4cfda228ea10 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:14.745646 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-73890d66-3a0b-46fa-9f64-4cfda228ea10 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:14.747361 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-73890d66-3a0b-46fa-9f64-4cfda228ea10 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:14.747972 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-73890d66-3a0b-46fa-9f64-4cfda228ea10 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:14.888839 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-73890d66-3a0b-46fa-9f64-4cfda228ea10 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:14.896881 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-73890d66-3a0b-46fa-9f64-4cfda228ea10 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:14.898481 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-73890d66-3a0b-46fa-9f64-4cfda228ea10 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:14.899920 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-73890d66-3a0b-46fa-9f64-4cfda228ea10 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1739 microversion: 2.20 time: 0.168112 May 19 15:08:14.901019 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 145/289] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:14 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:15.918561 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ea78c58a-dc7f-4c43-a23e-14dc7dc9aa26 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:15.919292 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ea78c58a-dc7f-4c43-a23e-14dc7dc9aa26 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:15.926193 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ea78c58a-dc7f-4c43-a23e-14dc7dc9aa26 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:15.926644 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ea78c58a-dc7f-4c43-a23e-14dc7dc9aa26 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:15.927443 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ea78c58a-dc7f-4c43-a23e-14dc7dc9aa26 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:15.927881 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ea78c58a-dc7f-4c43-a23e-14dc7dc9aa26 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:16.059622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ea78c58a-dc7f-4c43-a23e-14dc7dc9aa26 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:16.068366 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ea78c58a-dc7f-4c43-a23e-14dc7dc9aa26 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:16.069884 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ea78c58a-dc7f-4c43-a23e-14dc7dc9aa26 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:16.071087 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ea78c58a-dc7f-4c43-a23e-14dc7dc9aa26 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1721 microversion: 2.20 time: 0.156649 May 19 15:08:16.071686 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 145/290] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:15 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:17.089742 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e27ca891-07c3-4b04-a37e-55fc8d08b98f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:17.090353 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e27ca891-07c3-4b04-a37e-55fc8d08b98f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:17.097175 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e27ca891-07c3-4b04-a37e-55fc8d08b98f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:17.097632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e27ca891-07c3-4b04-a37e-55fc8d08b98f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:17.099041 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e27ca891-07c3-4b04-a37e-55fc8d08b98f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:17.099513 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e27ca891-07c3-4b04-a37e-55fc8d08b98f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:17.226017 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e27ca891-07c3-4b04-a37e-55fc8d08b98f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:17.233887 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e27ca891-07c3-4b04-a37e-55fc8d08b98f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:17.235425 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e27ca891-07c3-4b04-a37e-55fc8d08b98f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:17.236585 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e27ca891-07c3-4b04-a37e-55fc8d08b98f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1721 microversion: 2.20 time: 0.150752 May 19 15:08:17.237141 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 146/291] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:17 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:18.255444 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-645429a5-9631-40bd-9144-a612b1485a44 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:18.256062 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-645429a5-9631-40bd-9144-a612b1485a44 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:18.262982 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-645429a5-9631-40bd-9144-a612b1485a44 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:18.263465 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-645429a5-9631-40bd-9144-a612b1485a44 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:18.264226 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-645429a5-9631-40bd-9144-a612b1485a44 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:18.264658 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-645429a5-9631-40bd-9144-a612b1485a44 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:18.394914 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-645429a5-9631-40bd-9144-a612b1485a44 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:18.403393 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-645429a5-9631-40bd-9144-a612b1485a44 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:18.404901 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-645429a5-9631-40bd-9144-a612b1485a44 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:18.406054 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-645429a5-9631-40bd-9144-a612b1485a44 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1721 microversion: 2.20 time: 0.154836 May 19 15:08:18.406614 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 146/292] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:18 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:18.740034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4e2ed843-9a84-4de4-8aaa-5607f81c3637 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2e29a27-75c6-48ac-9fbd-4c61380157ab", "device": "/dev/sdb"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:08:18.741634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4e2ed843-9a84-4de4-8aaa-5607f81c3637 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:18.747833 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4e2ed843-9a84-4de4-8aaa-5607f81c3637 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:18.748284 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4e2ed843-9a84-4de4-8aaa-5607f81c3637 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:18.749044 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4e2ed843-9a84-4de4-8aaa-5607f81c3637 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:18.749481 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4e2ed843-9a84-4de4-8aaa-5607f81c3637 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:19.022463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4e2ed843-9a84-4de4-8aaa-5607f81c3637 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "POST /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286669 May 19 15:08:19.023064 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 147/293] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 15:08:18 2022] POST /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:08:19.424799 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-77223b7f-12f0-4dc3-98d0-7a7574041337 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:19.425508 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-77223b7f-12f0-4dc3-98d0-7a7574041337 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:19.434227 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-77223b7f-12f0-4dc3-98d0-7a7574041337 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:19.434769 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-77223b7f-12f0-4dc3-98d0-7a7574041337 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:19.435649 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-77223b7f-12f0-4dc3-98d0-7a7574041337 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:19.436403 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-77223b7f-12f0-4dc3-98d0-7a7574041337 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:19.488663 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-cac4a071-305b-4465-ac6f-4b59fa92526f req-a1aee4bc-50be-49ee-b87e-4c1748563008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6324753a-5912-42c2-a1f4-0bc631bea605", "name": "network-vif-unplugged", "status": "completed", "tag": "3beaa750-59c9-4ce6-b188-390d70f3fb7a"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:08:19.499847 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-cac4a071-305b-4465-ac6f-4b59fa92526f req-a1aee4bc-50be-49ee-b87e-4c1748563008 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:19.500289 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-cac4a071-305b-4465-ac6f-4b59fa92526f req-a1aee4bc-50be-49ee-b87e-4c1748563008 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:19.512281 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.compute.server_external_events [req-cac4a071-305b-4465-ac6f-4b59fa92526f req-a1aee4bc-50be-49ee-b87e-4c1748563008 service nova] Unable to find a host for instance 6324753a-5912-42c2-a1f4-0bc631bea605. Dropping event network-vif-unplugged {{(pid=117444) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 15:08:19.513344 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-cac4a071-305b-4465-ac6f-4b59fa92526f req-a1aee4bc-50be-49ee-b87e-4c1748563008 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028948 May 19 15:08:19.514086 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 148/294] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 19 15:08:19.619085 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-77223b7f-12f0-4dc3-98d0-7a7574041337 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:19.627592 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-77223b7f-12f0-4dc3-98d0-7a7574041337 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:19.629149 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-77223b7f-12f0-4dc3-98d0-7a7574041337 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:19.630309 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-77223b7f-12f0-4dc3-98d0-7a7574041337 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1664 microversion: 2.20 time: 0.209496 May 19 15:08:19.630859 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 147/295] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:19 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1664 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:19.647383 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-aba65421-ca11-4681-a87a-a47d23e67122 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b3fb604-3097-480f-82b0-382f47aed7ce"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:08:19.648477 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-aba65421-ca11-4681-a87a-a47d23e67122 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:19.654841 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aba65421-ca11-4681-a87a-a47d23e67122 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:19.655326 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aba65421-ca11-4681-a87a-a47d23e67122 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:19.656078 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aba65421-ca11-4681-a87a-a47d23e67122 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:19.656541 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aba65421-ca11-4681-a87a-a47d23e67122 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:19.917700 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2042235561", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1235658748", "security_groups": [{"name": "tempest-secgroup-smoke-1975589445"}], "block_device_mapping_v2": [{"uuid": "6aca48af-8857-4092-b68d-23c9cfd05419", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c953f990-ab01-4a12-ad62-ff0b653ea46c"}]}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:08:19.994423 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-aba65421-ca11-4681-a87a-a47d23e67122 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "POST /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.350986 May 19 15:08:19.995633 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 149/296] 10.222.0.24 () {62 vars in 1363 bytes} [Thu May 19 15:08:19 2022] POST /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/os-volume_attachments => generated 188 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 15:08:20.035443 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.network.neutron [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] validate_networks() for [('c953f990-ab01-4a12-ad62-ff0b653ea46c', None, None, None, None, None)] {{(pid=117445) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:08:20.116600 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ca59b875-e883-4d27-8645-1fcfef906c3c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:08:20.117487 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ca59b875-e883-4d27-8645-1fcfef906c3c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:20.123346 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca59b875-e883-4d27-8645-1fcfef906c3c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:20.123794 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca59b875-e883-4d27-8645-1fcfef906c3c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:20.124738 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca59b875-e883-4d27-8645-1fcfef906c3c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:20.125334 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca59b875-e883-4d27-8645-1fcfef906c3c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:20.225070 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ca59b875-e883-4d27-8645-1fcfef906c3c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "POST /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/action" status: 202 len: 0 microversion: 2.20 time: 0.113409 May 19 15:08:20.225988 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 150/297] 10.222.0.24 () {62 vars in 1318 bytes} [Thu May 19 15:08:20 2022] POST /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 15:08:20.233987 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6df96557-bf1e-44e7-8201-fa45183f3a39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:20.234511 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6df96557-bf1e-44e7-8201-fa45183f3a39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:20.240654 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6df96557-bf1e-44e7-8201-fa45183f3a39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:20.241117 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6df96557-bf1e-44e7-8201-fa45183f3a39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:20.241894 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6df96557-bf1e-44e7-8201-fa45183f3a39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:20.242337 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6df96557-bf1e-44e7-8201-fa45183f3a39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:20.467166 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6df96557-bf1e-44e7-8201-fa45183f3a39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:20.476052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6df96557-bf1e-44e7-8201-fa45183f3a39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:20.477809 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6df96557-bf1e-44e7-8201-fa45183f3a39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:20.479184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6df96557-bf1e-44e7-8201-fa45183f3a39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1750 microversion: 2.20 time: 0.249052 May 19 15:08:20.479839 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 151/298] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:20 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1750 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:08:20.501974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Flavor limits 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:08:20.502418 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Image limits 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:08:20.502874 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Flavor pref 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:08:20.503374 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Image pref 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:08:20.503801 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:08:20.513644 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:20.514096 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:20.514904 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:20.515380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:20.523907 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=100 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:20.535425 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Getting quotas for project 2c71bc8f0a164884bc0c046fd1e7faab. Resources: {'cores', 'instances', 'ram'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:08:20.539428 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Getting quotas for user 9877b9bbc14141bba21625fc8f1046d2 and project 2c71bc8f0a164884bc0c046fd1e7faab. Resources: {'cores', 'instances', 'ram'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:08:20.600278 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Going to run 1 instances... {{(pid=117445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:08:20.602818 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6aca48af-8857-4092-b68d-23c9cfd05419',volume_size=None,volume_type=None)] {{(pid=117445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:08:20.734711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-1dbd64ea-cf9c-4a53-9789-e564a2d1823a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.820734 May 19 15:08:20.740962 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 148/299] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:08:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 15:08:20.747017 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e6e94f05-bbcb-4401-9a18-a695e953a92d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:20.750013 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e6e94f05-bbcb-4401-9a18-a695e953a92d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:21.035123 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e6e94f05-bbcb-4401-9a18-a695e953a92d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:21.044104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e6e94f05-bbcb-4401-9a18-a695e953a92d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1095 microversion: 2.1 time: 0.302196 May 19 15:08:21.044676 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 152/300] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:20 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1095 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:08:21.498437 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-87eae50a-7310-4b20-9bc0-bd9f65ceb14e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:21.498971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-87eae50a-7310-4b20-9bc0-bd9f65ceb14e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:21.505738 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-87eae50a-7310-4b20-9bc0-bd9f65ceb14e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:21.506321 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-87eae50a-7310-4b20-9bc0-bd9f65ceb14e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:21.506945 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-87eae50a-7310-4b20-9bc0-bd9f65ceb14e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:21.507425 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-87eae50a-7310-4b20-9bc0-bd9f65ceb14e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:21.635268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-87eae50a-7310-4b20-9bc0-bd9f65ceb14e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:21.643710 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-87eae50a-7310-4b20-9bc0-bd9f65ceb14e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:21.645275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-87eae50a-7310-4b20-9bc0-bd9f65ceb14e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:21.646442 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-87eae50a-7310-4b20-9bc0-bd9f65ceb14e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1750 microversion: 2.20 time: 0.152813 May 19 15:08:21.647009 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 149/301] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:21 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:22.060572 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-48ccd1d5-2b2b-4fe3-bf68-794f4b62f78f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:22.061308 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-48ccd1d5-2b2b-4fe3-bf68-794f4b62f78f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:22.068604 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-48ccd1d5-2b2b-4fe3-bf68-794f4b62f78f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:22.069064 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-48ccd1d5-2b2b-4fe3-bf68-794f4b62f78f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:22.069841 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-48ccd1d5-2b2b-4fe3-bf68-794f4b62f78f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:22.070289 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-48ccd1d5-2b2b-4fe3-bf68-794f4b62f78f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:22.132379 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-48ccd1d5-2b2b-4fe3-bf68-794f4b62f78f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:22.134870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:22.141462 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-48ccd1d5-2b2b-4fe3-bf68-794f4b62f78f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1211 microversion: 2.1 time: 0.084797 May 19 15:08:22.142035 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 153/302] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:22 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:22.665166 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9338d7d5-a18e-4fb8-b84e-4ae684832ab1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:22.665873 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-9338d7d5-a18e-4fb8-b84e-4ae684832ab1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:22.672491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9338d7d5-a18e-4fb8-b84e-4ae684832ab1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:22.673150 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9338d7d5-a18e-4fb8-b84e-4ae684832ab1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:22.673924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9338d7d5-a18e-4fb8-b84e-4ae684832ab1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:22.674365 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9338d7d5-a18e-4fb8-b84e-4ae684832ab1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:22.805740 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9338d7d5-a18e-4fb8-b84e-4ae684832ab1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:22.814196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9338d7d5-a18e-4fb8-b84e-4ae684832ab1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:22.815839 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9338d7d5-a18e-4fb8-b84e-4ae684832ab1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:22.817611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9338d7d5-a18e-4fb8-b84e-4ae684832ab1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1752 microversion: 2.20 time: 0.156243 May 19 15:08:22.818245 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 150/303] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:22 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:23.128140 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-76c7473e-f5ef-40bf-8245-a255bde33ceb req-d3dd9310-5b59-4131-9d8a-a23c6fae2a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a43fdf07-dfad-4813-9f02-1de4e886eb18", "tag": "6d4f2f1d-bc4f-469b-a086-62fc903f5044"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:08:23.148948 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-76c7473e-f5ef-40bf-8245-a255bde33ceb req-d3dd9310-5b59-4131-9d8a-a23c6fae2a13 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:23.149500 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-76c7473e-f5ef-40bf-8245-a255bde33ceb req-d3dd9310-5b59-4131-9d8a-a23c6fae2a13 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:23.160089 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-accc4496-b58f-4496-bbc4-f59af24332de tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:23.162042 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-accc4496-b58f-4496-bbc4-f59af24332de tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:23.164818 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-76c7473e-f5ef-40bf-8245-a255bde33ceb req-d3dd9310-5b59-4131-9d8a-a23c6fae2a13 service nova] Creating event network-changed:6d4f2f1d-bc4f-469b-a086-62fc903f5044 for instance a43fdf07-dfad-4813-9f02-1de4e886eb18 on hv-cinder-82549 May 19 15:08:23.170592 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-76c7473e-f5ef-40bf-8245-a255bde33ceb req-d3dd9310-5b59-4131-9d8a-a23c6fae2a13 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045982 May 19 15:08:23.171741 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 154/304] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:08:23.176438 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-accc4496-b58f-4496-bbc4-f59af24332de tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:23.176900 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-accc4496-b58f-4496-bbc4-f59af24332de tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:23.177683 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-accc4496-b58f-4496-bbc4-f59af24332de tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:23.178120 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-accc4496-b58f-4496-bbc4-f59af24332de tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:23.344888 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-accc4496-b58f-4496-bbc4-f59af24332de tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:23.352551 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-accc4496-b58f-4496-bbc4-f59af24332de tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1279 microversion: 2.1 time: 0.197585 May 19 15:08:23.353133 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 151/305] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:23 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1279 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:23.836986 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8bba1103-295c-4ea0-b84e-993a7427e4a9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:23.837695 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8bba1103-295c-4ea0-b84e-993a7427e4a9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:23.844506 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8bba1103-295c-4ea0-b84e-993a7427e4a9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:23.844960 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8bba1103-295c-4ea0-b84e-993a7427e4a9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:23.845743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8bba1103-295c-4ea0-b84e-993a7427e4a9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:23.846184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8bba1103-295c-4ea0-b84e-993a7427e4a9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:23.977049 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8bba1103-295c-4ea0-b84e-993a7427e4a9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:23.985853 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8bba1103-295c-4ea0-b84e-993a7427e4a9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:23.987398 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8bba1103-295c-4ea0-b84e-993a7427e4a9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:23.989054 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8bba1103-295c-4ea0-b84e-993a7427e4a9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1752 microversion: 2.20 time: 0.156204 May 19 15:08:23.989615 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 155/306] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:23 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:24.369447 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-812fa5f7-9c7b-406b-9f51-defe4a948914 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:24.370321 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-812fa5f7-9c7b-406b-9f51-defe4a948914 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:24.376954 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-812fa5f7-9c7b-406b-9f51-defe4a948914 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:24.377419 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-812fa5f7-9c7b-406b-9f51-defe4a948914 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:24.378195 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-812fa5f7-9c7b-406b-9f51-defe4a948914 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:24.378639 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-812fa5f7-9c7b-406b-9f51-defe4a948914 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:24.508157 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-812fa5f7-9c7b-406b-9f51-defe4a948914 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:24.515583 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-812fa5f7-9c7b-406b-9f51-defe4a948914 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1279 microversion: 2.1 time: 0.149870 May 19 15:08:24.516154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 152/307] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:24 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1279 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:25.007910 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dc72a628-da0b-451f-b44e-4fe95e38fef3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:25.008524 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-dc72a628-da0b-451f-b44e-4fe95e38fef3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:25.014966 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc72a628-da0b-451f-b44e-4fe95e38fef3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:25.015454 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc72a628-da0b-451f-b44e-4fe95e38fef3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:25.016223 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc72a628-da0b-451f-b44e-4fe95e38fef3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:25.016671 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dc72a628-da0b-451f-b44e-4fe95e38fef3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:25.143170 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dc72a628-da0b-451f-b44e-4fe95e38fef3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:25.152269 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dc72a628-da0b-451f-b44e-4fe95e38fef3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:25.153763 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dc72a628-da0b-451f-b44e-4fe95e38fef3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:25.154948 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-dc72a628-da0b-451f-b44e-4fe95e38fef3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1752 microversion: 2.20 time: 0.151571 May 19 15:08:25.155687 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 156/308] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:25 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:25.532174 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b9373841-c395-440d-9c49-3eab13b81925 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:25.532817 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b9373841-c395-440d-9c49-3eab13b81925 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:25.539727 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b9373841-c395-440d-9c49-3eab13b81925 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:25.540180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b9373841-c395-440d-9c49-3eab13b81925 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:25.540942 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b9373841-c395-440d-9c49-3eab13b81925 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:25.541378 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b9373841-c395-440d-9c49-3eab13b81925 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:25.670885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-b9373841-c395-440d-9c49-3eab13b81925 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:25.678902 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-b9373841-c395-440d-9c49-3eab13b81925 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1279 microversion: 2.1 time: 0.150556 May 19 15:08:25.679488 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 153/309] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:25 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1279 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:26.172841 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dd7a631c-09b0-4d0d-94c6-ecb3e96aa748 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:26.173445 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-dd7a631c-09b0-4d0d-94c6-ecb3e96aa748 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:26.175840 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:26.181524 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd7a631c-09b0-4d0d-94c6-ecb3e96aa748 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:26.181973 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd7a631c-09b0-4d0d-94c6-ecb3e96aa748 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:26.182722 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd7a631c-09b0-4d0d-94c6-ecb3e96aa748 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:26.183153 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd7a631c-09b0-4d0d-94c6-ecb3e96aa748 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:26.313331 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dd7a631c-09b0-4d0d-94c6-ecb3e96aa748 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:26.321725 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dd7a631c-09b0-4d0d-94c6-ecb3e96aa748 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:26.323227 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dd7a631c-09b0-4d0d-94c6-ecb3e96aa748 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:26.324386 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-dd7a631c-09b0-4d0d-94c6-ecb3e96aa748 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1752 microversion: 2.20 time: 0.155379 May 19 15:08:26.324940 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 157/310] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:26 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:26.695859 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-1c6e6924-7644-4d85-b6da-4bc4b10f2ec3 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:26.696401 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-1c6e6924-7644-4d85-b6da-4bc4b10f2ec3 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:26.702830 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1c6e6924-7644-4d85-b6da-4bc4b10f2ec3 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:26.703311 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1c6e6924-7644-4d85-b6da-4bc4b10f2ec3 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:26.704067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1c6e6924-7644-4d85-b6da-4bc4b10f2ec3 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:26.704497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1c6e6924-7644-4d85-b6da-4bc4b10f2ec3 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:26.832722 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-1c6e6924-7644-4d85-b6da-4bc4b10f2ec3 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:26.840019 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-1c6e6924-7644-4d85-b6da-4bc4b10f2ec3 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1279 microversion: 2.1 time: 0.148093 May 19 15:08:26.840578 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 154/311] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:26 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1279 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:27.341929 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c8267ede-ae3f-473d-a4e1-916fb37fe935 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:27.342534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c8267ede-ae3f-473d-a4e1-916fb37fe935 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:27.349471 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c8267ede-ae3f-473d-a4e1-916fb37fe935 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:27.349916 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c8267ede-ae3f-473d-a4e1-916fb37fe935 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:27.350671 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c8267ede-ae3f-473d-a4e1-916fb37fe935 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:27.351100 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c8267ede-ae3f-473d-a4e1-916fb37fe935 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:27.485454 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c8267ede-ae3f-473d-a4e1-916fb37fe935 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:27.493701 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c8267ede-ae3f-473d-a4e1-916fb37fe935 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:27.495474 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c8267ede-ae3f-473d-a4e1-916fb37fe935 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:27.496717 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c8267ede-ae3f-473d-a4e1-916fb37fe935 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1752 microversion: 2.20 time: 0.158716 May 19 15:08:27.497264 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 158/312] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:27 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:27.855851 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b859c396-85f9-4184-a390-56c064db4bd2 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:27.856386 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b859c396-85f9-4184-a390-56c064db4bd2 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:27.862779 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b859c396-85f9-4184-a390-56c064db4bd2 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:27.863248 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b859c396-85f9-4184-a390-56c064db4bd2 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:27.864008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b859c396-85f9-4184-a390-56c064db4bd2 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:27.864439 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b859c396-85f9-4184-a390-56c064db4bd2 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:27.989768 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-b859c396-85f9-4184-a390-56c064db4bd2 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:27.997437 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-b859c396-85f9-4184-a390-56c064db4bd2 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1279 microversion: 2.1 time: 0.145532 May 19 15:08:27.998005 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 155/313] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:27 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1279 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:28.513999 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2b7ddc39-fb8d-4bf0-a2a1-2fc28c8054b2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:28.514850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2b7ddc39-fb8d-4bf0-a2a1-2fc28c8054b2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:28.521852 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2b7ddc39-fb8d-4bf0-a2a1-2fc28c8054b2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:28.522307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2b7ddc39-fb8d-4bf0-a2a1-2fc28c8054b2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:28.523108 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2b7ddc39-fb8d-4bf0-a2a1-2fc28c8054b2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:28.523582 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2b7ddc39-fb8d-4bf0-a2a1-2fc28c8054b2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:28.667639 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2b7ddc39-fb8d-4bf0-a2a1-2fc28c8054b2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:28.676774 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2b7ddc39-fb8d-4bf0-a2a1-2fc28c8054b2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:28.678292 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2b7ddc39-fb8d-4bf0-a2a1-2fc28c8054b2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:28.679477 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2b7ddc39-fb8d-4bf0-a2a1-2fc28c8054b2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1752 microversion: 2.20 time: 0.169508 May 19 15:08:28.680044 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 159/314] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:28 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:29.013809 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c9ea4da0-144c-439b-a6c9-3fa698eef652 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:29.014453 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c9ea4da0-144c-439b-a6c9-3fa698eef652 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:29.021524 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c9ea4da0-144c-439b-a6c9-3fa698eef652 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:29.021970 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c9ea4da0-144c-439b-a6c9-3fa698eef652 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:29.022735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c9ea4da0-144c-439b-a6c9-3fa698eef652 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:29.023174 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c9ea4da0-144c-439b-a6c9-3fa698eef652 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:29.148549 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c9ea4da0-144c-439b-a6c9-3fa698eef652 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:29.156027 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c9ea4da0-144c-439b-a6c9-3fa698eef652 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1279 microversion: 2.1 time: 0.146047 May 19 15:08:29.156596 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 156/315] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:29 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1279 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:08:29.697936 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f0be7130-5b31-4153-8f0c-65c2a9c2ab6e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:29.698545 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f0be7130-5b31-4153-8f0c-65c2a9c2ab6e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:29.705022 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f0be7130-5b31-4153-8f0c-65c2a9c2ab6e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:29.705479 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f0be7130-5b31-4153-8f0c-65c2a9c2ab6e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:29.706240 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f0be7130-5b31-4153-8f0c-65c2a9c2ab6e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:29.706677 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f0be7130-5b31-4153-8f0c-65c2a9c2ab6e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:29.834804 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f0be7130-5b31-4153-8f0c-65c2a9c2ab6e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:29.843240 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f0be7130-5b31-4153-8f0c-65c2a9c2ab6e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:29.844750 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f0be7130-5b31-4153-8f0c-65c2a9c2ab6e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:29.845906 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f0be7130-5b31-4153-8f0c-65c2a9c2ab6e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1752 microversion: 2.20 time: 0.151796 May 19 15:08:29.846463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 160/316] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:29 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:30.173415 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e76c8f05-5b22-4ed7-8044-53e981a8e46f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:30.174027 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e76c8f05-5b22-4ed7-8044-53e981a8e46f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:30.180504 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e76c8f05-5b22-4ed7-8044-53e981a8e46f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:30.180956 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e76c8f05-5b22-4ed7-8044-53e981a8e46f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:30.181718 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e76c8f05-5b22-4ed7-8044-53e981a8e46f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:30.182158 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e76c8f05-5b22-4ed7-8044-53e981a8e46f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:30.314195 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e76c8f05-5b22-4ed7-8044-53e981a8e46f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:30.322131 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e76c8f05-5b22-4ed7-8044-53e981a8e46f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1279 microversion: 2.1 time: 0.152623 May 19 15:08:30.322765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 157/317] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:30 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1279 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:30.866197 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a730a59b-a15a-4ca1-be36-493eea47d820 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:30.866937 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a730a59b-a15a-4ca1-be36-493eea47d820 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:30.875242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a730a59b-a15a-4ca1-be36-493eea47d820 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:30.875703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a730a59b-a15a-4ca1-be36-493eea47d820 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:30.876484 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a730a59b-a15a-4ca1-be36-493eea47d820 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:30.876943 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a730a59b-a15a-4ca1-be36-493eea47d820 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:31.034266 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a730a59b-a15a-4ca1-be36-493eea47d820 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:31.042130 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:31.047718 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a730a59b-a15a-4ca1-be36-493eea47d820 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:31.049922 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a730a59b-a15a-4ca1-be36-493eea47d820 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:31.051941 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a730a59b-a15a-4ca1-be36-493eea47d820 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1752 microversion: 2.20 time: 0.190928 May 19 15:08:31.052519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 161/318] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:30 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1752 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:31.339605 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a40f9924-17a5-4a0f-b36d-c7f81aee1e9f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:31.340205 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-a40f9924-17a5-4a0f-b36d-c7f81aee1e9f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:31.342036 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=2 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:31.342725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=6 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:31.350155 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a40f9924-17a5-4a0f-b36d-c7f81aee1e9f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:31.350658 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a40f9924-17a5-4a0f-b36d-c7f81aee1e9f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:31.351415 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a40f9924-17a5-4a0f-b36d-c7f81aee1e9f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:31.351880 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a40f9924-17a5-4a0f-b36d-c7f81aee1e9f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:31.505915 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-a40f9924-17a5-4a0f-b36d-c7f81aee1e9f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:31.514545 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-a40f9924-17a5-4a0f-b36d-c7f81aee1e9f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1279 microversion: 2.1 time: 0.178774 May 19 15:08:31.515747 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 158/319] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:31 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:32.070620 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-36e9495f-4512-4cf6-8e4a-ff126171969f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:32.071252 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-36e9495f-4512-4cf6-8e4a-ff126171969f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:32.078052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-36e9495f-4512-4cf6-8e4a-ff126171969f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:32.078509 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-36e9495f-4512-4cf6-8e4a-ff126171969f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:32.079301 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-36e9495f-4512-4cf6-8e4a-ff126171969f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:32.079738 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-36e9495f-4512-4cf6-8e4a-ff126171969f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:32.215021 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-36e9495f-4512-4cf6-8e4a-ff126171969f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:32.223931 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-36e9495f-4512-4cf6-8e4a-ff126171969f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:32.225525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-36e9495f-4512-4cf6-8e4a-ff126171969f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:32.226717 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-36e9495f-4512-4cf6-8e4a-ff126171969f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.160426 May 19 15:08:32.227516 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 162/320] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:32 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:32.532753 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c52dbd93-c3c1-4fc0-b646-9539a2cde763 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:32.533295 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c52dbd93-c3c1-4fc0-b646-9539a2cde763 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:32.536164 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:32.541694 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c52dbd93-c3c1-4fc0-b646-9539a2cde763 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:32.542150 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c52dbd93-c3c1-4fc0-b646-9539a2cde763 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:32.542927 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c52dbd93-c3c1-4fc0-b646-9539a2cde763 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:32.543416 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c52dbd93-c3c1-4fc0-b646-9539a2cde763 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:32.686246 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c52dbd93-c3c1-4fc0-b646-9539a2cde763 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:32.693614 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c52dbd93-c3c1-4fc0-b646-9539a2cde763 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.164858 May 19 15:08:32.694168 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 159/321] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:32 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:33.245585 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1fa62aa6-736f-4fd0-b3ad-13e154019601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:33.246137 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1fa62aa6-736f-4fd0-b3ad-13e154019601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:33.252684 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1fa62aa6-736f-4fd0-b3ad-13e154019601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:33.253136 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1fa62aa6-736f-4fd0-b3ad-13e154019601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:33.253905 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1fa62aa6-736f-4fd0-b3ad-13e154019601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:33.254347 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1fa62aa6-736f-4fd0-b3ad-13e154019601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:33.391127 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1fa62aa6-736f-4fd0-b3ad-13e154019601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:33.400067 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1fa62aa6-736f-4fd0-b3ad-13e154019601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:33.401561 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1fa62aa6-736f-4fd0-b3ad-13e154019601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:33.402709 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1fa62aa6-736f-4fd0-b3ad-13e154019601 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.161346 May 19 15:08:33.403301 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 163/322] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:33 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:33.711221 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-542964ec-5ea2-43b2-87aa-0950b8069823 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:33.711860 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-542964ec-5ea2-43b2-87aa-0950b8069823 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:33.718349 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-542964ec-5ea2-43b2-87aa-0950b8069823 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:33.718805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-542964ec-5ea2-43b2-87aa-0950b8069823 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:33.719607 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-542964ec-5ea2-43b2-87aa-0950b8069823 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:33.720049 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-542964ec-5ea2-43b2-87aa-0950b8069823 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:33.847120 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-542964ec-5ea2-43b2-87aa-0950b8069823 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:33.854542 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-542964ec-5ea2-43b2-87aa-0950b8069823 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.147731 May 19 15:08:33.855119 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 160/323] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:33 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:34.421441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c85bc69e-d923-4a9b-a670-3e319d90424d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:34.422045 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c85bc69e-d923-4a9b-a670-3e319d90424d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:34.429045 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c85bc69e-d923-4a9b-a670-3e319d90424d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:34.429489 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c85bc69e-d923-4a9b-a670-3e319d90424d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:34.430241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c85bc69e-d923-4a9b-a670-3e319d90424d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:34.430675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c85bc69e-d923-4a9b-a670-3e319d90424d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:34.561127 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c85bc69e-d923-4a9b-a670-3e319d90424d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:34.569492 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c85bc69e-d923-4a9b-a670-3e319d90424d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:34.570979 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c85bc69e-d923-4a9b-a670-3e319d90424d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:34.572219 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c85bc69e-d923-4a9b-a670-3e319d90424d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.154679 May 19 15:08:34.572786 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 164/324] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:34 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:34.871995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-76456a38-7ffe-4a36-904b-e9b363de462b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:34.872532 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-76456a38-7ffe-4a36-904b-e9b363de462b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:34.878989 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-76456a38-7ffe-4a36-904b-e9b363de462b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:34.879482 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-76456a38-7ffe-4a36-904b-e9b363de462b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:34.880250 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-76456a38-7ffe-4a36-904b-e9b363de462b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:34.880694 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-76456a38-7ffe-4a36-904b-e9b363de462b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:35.012095 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-76456a38-7ffe-4a36-904b-e9b363de462b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:35.020160 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-76456a38-7ffe-4a36-904b-e9b363de462b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.151747 May 19 15:08:35.020735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 161/325] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:34 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:35.590011 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-361fe5fd-a220-42c6-8289-86ce21e55944 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:35.590629 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-361fe5fd-a220-42c6-8289-86ce21e55944 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:35.597172 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-361fe5fd-a220-42c6-8289-86ce21e55944 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:35.598119 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-361fe5fd-a220-42c6-8289-86ce21e55944 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:35.598930 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-361fe5fd-a220-42c6-8289-86ce21e55944 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:35.599458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-361fe5fd-a220-42c6-8289-86ce21e55944 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:35.739729 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-361fe5fd-a220-42c6-8289-86ce21e55944 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:35.749987 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-361fe5fd-a220-42c6-8289-86ce21e55944 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:35.752727 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-361fe5fd-a220-42c6-8289-86ce21e55944 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:35.754086 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-361fe5fd-a220-42c6-8289-86ce21e55944 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.167917 May 19 15:08:35.755172 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 165/326] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:35 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:36.037341 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-53a763d3-457b-40f3-9892-9f416570cd13 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:36.037940 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-53a763d3-457b-40f3-9892-9f416570cd13 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:36.044346 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-53a763d3-457b-40f3-9892-9f416570cd13 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:36.044807 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-53a763d3-457b-40f3-9892-9f416570cd13 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:36.045612 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-53a763d3-457b-40f3-9892-9f416570cd13 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:36.046052 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-53a763d3-457b-40f3-9892-9f416570cd13 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:36.178154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-53a763d3-457b-40f3-9892-9f416570cd13 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:36.186426 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-53a763d3-457b-40f3-9892-9f416570cd13 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.153339 May 19 15:08:36.187291 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 162/327] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:36 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:36.772849 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d8f157e4-3ce4-453c-bc1d-8cbd71687bcc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:36.773388 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d8f157e4-3ce4-453c-bc1d-8cbd71687bcc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:36.779983 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d8f157e4-3ce4-453c-bc1d-8cbd71687bcc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:36.780667 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d8f157e4-3ce4-453c-bc1d-8cbd71687bcc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:36.781605 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d8f157e4-3ce4-453c-bc1d-8cbd71687bcc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:36.782191 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d8f157e4-3ce4-453c-bc1d-8cbd71687bcc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:36.919573 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d8f157e4-3ce4-453c-bc1d-8cbd71687bcc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:36.928208 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d8f157e4-3ce4-453c-bc1d-8cbd71687bcc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:36.929704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d8f157e4-3ce4-453c-bc1d-8cbd71687bcc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:36.930863 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d8f157e4-3ce4-453c-bc1d-8cbd71687bcc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.162487 May 19 15:08:36.931463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 166/328] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:36 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:37.204204 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-2c613651-bc70-49fb-a979-26ec5d368e42 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:37.204894 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-2c613651-bc70-49fb-a979-26ec5d368e42 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:37.211446 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2c613651-bc70-49fb-a979-26ec5d368e42 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:37.211902 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2c613651-bc70-49fb-a979-26ec5d368e42 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:37.212669 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2c613651-bc70-49fb-a979-26ec5d368e42 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:37.213111 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2c613651-bc70-49fb-a979-26ec5d368e42 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:37.342653 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-2c613651-bc70-49fb-a979-26ec5d368e42 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:37.350034 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-2c613651-bc70-49fb-a979-26ec5d368e42 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.149696 May 19 15:08:37.350594 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 163/329] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:37 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:37.949252 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f558c8d7-5a7a-4f84-b16d-b80e25b4c1c3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:37.949940 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f558c8d7-5a7a-4f84-b16d-b80e25b4c1c3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:37.956362 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f558c8d7-5a7a-4f84-b16d-b80e25b4c1c3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:37.957301 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f558c8d7-5a7a-4f84-b16d-b80e25b4c1c3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:37.958052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f558c8d7-5a7a-4f84-b16d-b80e25b4c1c3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:37.958484 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f558c8d7-5a7a-4f84-b16d-b80e25b4c1c3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:38.084075 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f558c8d7-5a7a-4f84-b16d-b80e25b4c1c3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:38.092529 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f558c8d7-5a7a-4f84-b16d-b80e25b4c1c3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:38.094028 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f558c8d7-5a7a-4f84-b16d-b80e25b4c1c3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:38.095278 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f558c8d7-5a7a-4f84-b16d-b80e25b4c1c3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.149837 May 19 15:08:38.095826 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 167/330] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:37 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:38.366165 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-779ce435-7e11-4830-a0c3-e6a7c11a8f64 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:38.366792 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-779ce435-7e11-4830-a0c3-e6a7c11a8f64 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:38.373724 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-779ce435-7e11-4830-a0c3-e6a7c11a8f64 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:38.374183 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-779ce435-7e11-4830-a0c3-e6a7c11a8f64 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:38.374953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-779ce435-7e11-4830-a0c3-e6a7c11a8f64 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:38.375428 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-779ce435-7e11-4830-a0c3-e6a7c11a8f64 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:38.535035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-779ce435-7e11-4830-a0c3-e6a7c11a8f64 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:38.542638 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-779ce435-7e11-4830-a0c3-e6a7c11a8f64 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.180329 May 19 15:08:38.543626 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 164/331] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:38 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:39.114217 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b7ef198f-4436-4132-934a-c1ce81c50fb7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:39.114994 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b7ef198f-4436-4132-934a-c1ce81c50fb7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:39.122343 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7ef198f-4436-4132-934a-c1ce81c50fb7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:39.123230 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7ef198f-4436-4132-934a-c1ce81c50fb7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:39.124336 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7ef198f-4436-4132-934a-c1ce81c50fb7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:39.125105 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b7ef198f-4436-4132-934a-c1ce81c50fb7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:39.255779 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b7ef198f-4436-4132-934a-c1ce81c50fb7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:39.263944 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b7ef198f-4436-4132-934a-c1ce81c50fb7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:39.265430 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b7ef198f-4436-4132-934a-c1ce81c50fb7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:39.266574 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b7ef198f-4436-4132-934a-c1ce81c50fb7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.157220 May 19 15:08:39.267132 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 168/332] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:39 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:39.559455 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-59bd4d9e-3ee1-4b02-b4ac-d055ad55d921 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:39.560063 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-59bd4d9e-3ee1-4b02-b4ac-d055ad55d921 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:39.566156 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-59bd4d9e-3ee1-4b02-b4ac-d055ad55d921 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:39.566608 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-59bd4d9e-3ee1-4b02-b4ac-d055ad55d921 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:39.567414 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-59bd4d9e-3ee1-4b02-b4ac-d055ad55d921 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:39.567853 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-59bd4d9e-3ee1-4b02-b4ac-d055ad55d921 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:39.582703 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=100 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:39.703267 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-59bd4d9e-3ee1-4b02-b4ac-d055ad55d921 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:39.711072 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-59bd4d9e-3ee1-4b02-b4ac-d055ad55d921 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.155612 May 19 15:08:39.711813 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 165/333] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:39 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:40.284129 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9a2a7b84-0d87-4168-9555-a943b03ad342 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:40.284785 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9a2a7b84-0d87-4168-9555-a943b03ad342 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:40.292147 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9a2a7b84-0d87-4168-9555-a943b03ad342 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:40.292599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9a2a7b84-0d87-4168-9555-a943b03ad342 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:40.293367 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9a2a7b84-0d87-4168-9555-a943b03ad342 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:40.293796 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9a2a7b84-0d87-4168-9555-a943b03ad342 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:40.435406 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9a2a7b84-0d87-4168-9555-a943b03ad342 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:40.443719 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9a2a7b84-0d87-4168-9555-a943b03ad342 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:40.445222 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9a2a7b84-0d87-4168-9555-a943b03ad342 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:40.446371 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9a2a7b84-0d87-4168-9555-a943b03ad342 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.166229 May 19 15:08:40.449224 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 169/334] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:40 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:40.729289 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-80aa053a-688c-4108-aaa8-b78fa68c7fe6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:40.730739 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-80aa053a-688c-4108-aaa8-b78fa68c7fe6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:40.738364 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-80aa053a-688c-4108-aaa8-b78fa68c7fe6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:40.738824 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-80aa053a-688c-4108-aaa8-b78fa68c7fe6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:40.739674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-80aa053a-688c-4108-aaa8-b78fa68c7fe6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:40.740067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-80aa053a-688c-4108-aaa8-b78fa68c7fe6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:40.878996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-80aa053a-688c-4108-aaa8-b78fa68c7fe6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:40.886409 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-80aa053a-688c-4108-aaa8-b78fa68c7fe6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.162109 May 19 15:08:40.886978 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 166/335] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:40 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:41.467618 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dfdff1d2-5be2-4289-8eb8-186ec76456de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:41.468231 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-dfdff1d2-5be2-4289-8eb8-186ec76456de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:41.475139 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dfdff1d2-5be2-4289-8eb8-186ec76456de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:41.475625 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dfdff1d2-5be2-4289-8eb8-186ec76456de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:41.476394 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dfdff1d2-5be2-4289-8eb8-186ec76456de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:41.476834 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dfdff1d2-5be2-4289-8eb8-186ec76456de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:41.617862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dfdff1d2-5be2-4289-8eb8-186ec76456de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:41.628160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dfdff1d2-5be2-4289-8eb8-186ec76456de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:41.629776 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dfdff1d2-5be2-4289-8eb8-186ec76456de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:41.631347 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-dfdff1d2-5be2-4289-8eb8-186ec76456de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.167541 May 19 15:08:41.639757 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 170/336] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:41 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:41.904171 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-2f6276d2-51e4-459e-bd95-cfecb0ed78ef tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:41.904764 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-2f6276d2-51e4-459e-bd95-cfecb0ed78ef tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:41.911667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2f6276d2-51e4-459e-bd95-cfecb0ed78ef tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:41.912118 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2f6276d2-51e4-459e-bd95-cfecb0ed78ef tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:41.912887 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2f6276d2-51e4-459e-bd95-cfecb0ed78ef tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:41.913327 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2f6276d2-51e4-459e-bd95-cfecb0ed78ef tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:42.049946 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-2f6276d2-51e4-459e-bd95-cfecb0ed78ef tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:42.064457 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-2f6276d2-51e4-459e-bd95-cfecb0ed78ef tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.164114 May 19 15:08:42.065140 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 167/337] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:41 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:42.649250 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0eb64aa1-681e-4a35-a219-67348d4279b4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:42.649816 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0eb64aa1-681e-4a35-a219-67348d4279b4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:42.656317 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0eb64aa1-681e-4a35-a219-67348d4279b4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:42.656778 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0eb64aa1-681e-4a35-a219-67348d4279b4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:42.657551 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0eb64aa1-681e-4a35-a219-67348d4279b4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:42.657992 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0eb64aa1-681e-4a35-a219-67348d4279b4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:42.662777 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=100 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:42.801499 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0eb64aa1-681e-4a35-a219-67348d4279b4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:42.810752 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0eb64aa1-681e-4a35-a219-67348d4279b4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:42.812269 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0eb64aa1-681e-4a35-a219-67348d4279b4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:42.813432 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0eb64aa1-681e-4a35-a219-67348d4279b4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.168168 May 19 15:08:42.814005 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 171/338] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:42 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:43.085775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d69f7c0a-6583-41cb-af67-e71cba75564d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:43.086458 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-d69f7c0a-6583-41cb-af67-e71cba75564d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:43.093173 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d69f7c0a-6583-41cb-af67-e71cba75564d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:43.093519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d69f7c0a-6583-41cb-af67-e71cba75564d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:43.094313 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d69f7c0a-6583-41cb-af67-e71cba75564d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:43.094804 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d69f7c0a-6583-41cb-af67-e71cba75564d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:43.239191 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-d69f7c0a-6583-41cb-af67-e71cba75564d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:43.247279 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-d69f7c0a-6583-41cb-af67-e71cba75564d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.165191 May 19 15:08:43.247865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 168/339] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:43 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:43.834400 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-421a6f01-b6bb-4c80-a3b1-d39a84e19329 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:43.835014 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-421a6f01-b6bb-4c80-a3b1-d39a84e19329 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:43.841141 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-421a6f01-b6bb-4c80-a3b1-d39a84e19329 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:43.841594 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-421a6f01-b6bb-4c80-a3b1-d39a84e19329 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:43.842370 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-421a6f01-b6bb-4c80-a3b1-d39a84e19329 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:43.842811 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-421a6f01-b6bb-4c80-a3b1-d39a84e19329 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:43.980501 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-421a6f01-b6bb-4c80-a3b1-d39a84e19329 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:43.989611 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-421a6f01-b6bb-4c80-a3b1-d39a84e19329 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:43.991114 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-421a6f01-b6bb-4c80-a3b1-d39a84e19329 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:43.992315 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-421a6f01-b6bb-4c80-a3b1-d39a84e19329 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.164090 May 19 15:08:43.992883 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 172/340] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:43 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:44.268703 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-eada150d-0bdc-4f6d-a5a6-4541228bafd6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:44.269267 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-eada150d-0bdc-4f6d-a5a6-4541228bafd6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:44.276109 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-eada150d-0bdc-4f6d-a5a6-4541228bafd6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:44.276565 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-eada150d-0bdc-4f6d-a5a6-4541228bafd6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:44.277594 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-eada150d-0bdc-4f6d-a5a6-4541228bafd6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:44.278201 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-eada150d-0bdc-4f6d-a5a6-4541228bafd6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:44.418284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-eada150d-0bdc-4f6d-a5a6-4541228bafd6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:44.426731 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-eada150d-0bdc-4f6d-a5a6-4541228bafd6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.161874 May 19 15:08:44.427510 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 169/341] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:44 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:45.010674 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1718daed-1b03-4d08-815f-a91e95c27322 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:45.011287 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1718daed-1b03-4d08-815f-a91e95c27322 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:45.018060 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1718daed-1b03-4d08-815f-a91e95c27322 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:45.018521 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1718daed-1b03-4d08-815f-a91e95c27322 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:45.020160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1718daed-1b03-4d08-815f-a91e95c27322 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:45.021085 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1718daed-1b03-4d08-815f-a91e95c27322 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:45.173333 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1718daed-1b03-4d08-815f-a91e95c27322 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:45.183708 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1718daed-1b03-4d08-815f-a91e95c27322 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:45.185198 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1718daed-1b03-4d08-815f-a91e95c27322 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:45.186419 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1718daed-1b03-4d08-815f-a91e95c27322 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.179789 May 19 15:08:45.187157 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 173/342] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:45 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:45.444490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-523bda05-4572-43fb-9e77-075d31a44b2c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:45.445097 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-523bda05-4572-43fb-9e77-075d31a44b2c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:45.451732 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-523bda05-4572-43fb-9e77-075d31a44b2c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:45.452196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-523bda05-4572-43fb-9e77-075d31a44b2c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:45.452978 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-523bda05-4572-43fb-9e77-075d31a44b2c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:45.453419 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-523bda05-4572-43fb-9e77-075d31a44b2c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:45.594156 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-523bda05-4572-43fb-9e77-075d31a44b2c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:45.603232 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-523bda05-4572-43fb-9e77-075d31a44b2c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.163146 May 19 15:08:45.604576 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 170/343] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:45 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:46.205319 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-015f219c-da3c-4dba-bd6a-d6a8c2666df0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:46.206119 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-015f219c-da3c-4dba-bd6a-d6a8c2666df0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:46.225164 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-015f219c-da3c-4dba-bd6a-d6a8c2666df0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:46.225652 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-015f219c-da3c-4dba-bd6a-d6a8c2666df0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:46.226437 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-015f219c-da3c-4dba-bd6a-d6a8c2666df0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:46.227455 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-015f219c-da3c-4dba-bd6a-d6a8c2666df0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:46.385485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-015f219c-da3c-4dba-bd6a-d6a8c2666df0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:46.396500 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-015f219c-da3c-4dba-bd6a-d6a8c2666df0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:46.397803 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-015f219c-da3c-4dba-bd6a-d6a8c2666df0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:46.399229 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-015f219c-da3c-4dba-bd6a-d6a8c2666df0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.197920 May 19 15:08:46.399993 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 174/344] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:46 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:46.621394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d0cb01df-7a5f-45b1-a9de-af9ccfad75e5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:46.622019 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-d0cb01df-7a5f-45b1-a9de-af9ccfad75e5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:46.628963 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d0cb01df-7a5f-45b1-a9de-af9ccfad75e5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:46.629425 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d0cb01df-7a5f-45b1-a9de-af9ccfad75e5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:46.630737 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d0cb01df-7a5f-45b1-a9de-af9ccfad75e5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:46.631399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d0cb01df-7a5f-45b1-a9de-af9ccfad75e5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:46.779497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-d0cb01df-7a5f-45b1-a9de-af9ccfad75e5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:46.787130 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-d0cb01df-7a5f-45b1-a9de-af9ccfad75e5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.169774 May 19 15:08:46.787732 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 171/345] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:46 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:47.418630 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-394c79a7-28fd-42f6-b177-f32b85c64b5d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:47.420060 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-394c79a7-28fd-42f6-b177-f32b85c64b5d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:47.426606 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-394c79a7-28fd-42f6-b177-f32b85c64b5d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:47.427700 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-394c79a7-28fd-42f6-b177-f32b85c64b5d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:47.428487 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-394c79a7-28fd-42f6-b177-f32b85c64b5d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:47.428928 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-394c79a7-28fd-42f6-b177-f32b85c64b5d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:47.562737 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-394c79a7-28fd-42f6-b177-f32b85c64b5d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:47.571165 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-394c79a7-28fd-42f6-b177-f32b85c64b5d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:47.572638 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-394c79a7-28fd-42f6-b177-f32b85c64b5d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:47.573829 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-394c79a7-28fd-42f6-b177-f32b85c64b5d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.159301 May 19 15:08:47.574392 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 175/346] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:47 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:47.803969 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-007d8228-ef5c-40e1-9053-e23491f7e3af tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:47.804581 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-007d8228-ef5c-40e1-9053-e23491f7e3af tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:47.811096 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-007d8228-ef5c-40e1-9053-e23491f7e3af tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:47.811584 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-007d8228-ef5c-40e1-9053-e23491f7e3af tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:47.812381 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-007d8228-ef5c-40e1-9053-e23491f7e3af tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:47.812824 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-007d8228-ef5c-40e1-9053-e23491f7e3af tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:47.938433 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-007d8228-ef5c-40e1-9053-e23491f7e3af tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:47.946254 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-007d8228-ef5c-40e1-9053-e23491f7e3af tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.146292 May 19 15:08:47.946822 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 172/347] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:47 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:48.085874 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4705a93f-227f-4832-821f-bb3dd7587cdb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:48.086374 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4705a93f-227f-4832-821f-bb3dd7587cdb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:48.092420 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4705a93f-227f-4832-821f-bb3dd7587cdb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:48.092881 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4705a93f-227f-4832-821f-bb3dd7587cdb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:48.093644 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4705a93f-227f-4832-821f-bb3dd7587cdb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:48.094126 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4705a93f-227f-4832-821f-bb3dd7587cdb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:48.222935 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-4705a93f-227f-4832-821f-bb3dd7587cdb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lazy-loading 'services' on Instance uuid abfb9153-3ce0-4a77-bcaf-ff150167e0cd {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:08:48.337219 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4705a93f-227f-4832-821f-bb3dd7587cdb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "DELETE /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd/os-volume_attachments/e2e29a27-75c6-48ac-9fbd-4c61380157ab" status: 202 len: 0 microversion: 2.1 time: 0.255640 May 19 15:08:48.337816 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 176/348] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 15:08:48 2022] DELETE /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd/os-volume_attachments/e2e29a27-75c6-48ac-9fbd-4c61380157ab => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:08:48.592192 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-52c9b803-6687-4c16-a19f-3e5b78ac6ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:48.592716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-52c9b803-6687-4c16-a19f-3e5b78ac6ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:48.598678 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-52c9b803-6687-4c16-a19f-3e5b78ac6ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:48.599130 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-52c9b803-6687-4c16-a19f-3e5b78ac6ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:48.599937 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-52c9b803-6687-4c16-a19f-3e5b78ac6ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:48.600374 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-52c9b803-6687-4c16-a19f-3e5b78ac6ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:48.735543 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-52c9b803-6687-4c16-a19f-3e5b78ac6ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:48.744255 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-52c9b803-6687-4c16-a19f-3e5b78ac6ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:48.746007 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-52c9b803-6687-4c16-a19f-3e5b78ac6ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:48.747357 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-52c9b803-6687-4c16-a19f-3e5b78ac6ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.159021 May 19 15:08:48.747933 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 173/349] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:48 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:48.964309 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-61ec50b4-f318-4871-a16e-7f613dd6b6eb tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:48.964942 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-61ec50b4-f318-4871-a16e-7f613dd6b6eb tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:48.971231 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-61ec50b4-f318-4871-a16e-7f613dd6b6eb tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:48.971674 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-61ec50b4-f318-4871-a16e-7f613dd6b6eb tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:48.972429 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-61ec50b4-f318-4871-a16e-7f613dd6b6eb tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:48.972866 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-61ec50b4-f318-4871-a16e-7f613dd6b6eb tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:49.124539 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-61ec50b4-f318-4871-a16e-7f613dd6b6eb tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:49.132662 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-61ec50b4-f318-4871-a16e-7f613dd6b6eb tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.172781 May 19 15:08:49.133218 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 177/350] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:48 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:49.765734 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-1d05b558-f8ee-4c0c-b3ec-862e44fc5b73 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:49.766347 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-1d05b558-f8ee-4c0c-b3ec-862e44fc5b73 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:49.773679 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1d05b558-f8ee-4c0c-b3ec-862e44fc5b73 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:49.774128 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1d05b558-f8ee-4c0c-b3ec-862e44fc5b73 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:49.774890 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1d05b558-f8ee-4c0c-b3ec-862e44fc5b73 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:49.775425 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1d05b558-f8ee-4c0c-b3ec-862e44fc5b73 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:49.906034 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-1d05b558-f8ee-4c0c-b3ec-862e44fc5b73 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:49.914463 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-1d05b558-f8ee-4c0c-b3ec-862e44fc5b73 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:49.915931 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-1d05b558-f8ee-4c0c-b3ec-862e44fc5b73 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:49.917123 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-1d05b558-f8ee-4c0c-b3ec-862e44fc5b73 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.155234 May 19 15:08:49.917686 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 174/351] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:49 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:50.148978 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-074859cb-6495-4c06-ac2f-82d820155e5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:50.149600 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-074859cb-6495-4c06-ac2f-82d820155e5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:50.156094 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-074859cb-6495-4c06-ac2f-82d820155e5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:50.156541 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-074859cb-6495-4c06-ac2f-82d820155e5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:50.157293 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-074859cb-6495-4c06-ac2f-82d820155e5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:50.157721 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-074859cb-6495-4c06-ac2f-82d820155e5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:50.292957 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-074859cb-6495-4c06-ac2f-82d820155e5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:50.302633 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-074859cb-6495-4c06-ac2f-82d820155e5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.156947 May 19 15:08:50.303229 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 178/352] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:50 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:50.521204 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-48d819ff-2f94-45db-8e66-c4e00a1cbcfc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:50.521709 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-48d819ff-2f94-45db-8e66-c4e00a1cbcfc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:50.528052 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-48d819ff-2f94-45db-8e66-c4e00a1cbcfc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:50.528503 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-48d819ff-2f94-45db-8e66-c4e00a1cbcfc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:50.529345 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-48d819ff-2f94-45db-8e66-c4e00a1cbcfc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:50.529834 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-48d819ff-2f94-45db-8e66-c4e00a1cbcfc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:50.554856 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-48d819ff-2f94-45db-8e66-c4e00a1cbcfc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Going to try to terminate instance {{(pid=117445) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:08:50.628453 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-48d819ff-2f94-45db-8e66-c4e00a1cbcfc tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "DELETE /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd" status: 204 len: 0 microversion: 2.1 time: 0.113585 May 19 15:08:50.629038 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 175/353] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:08:50 2022] DELETE /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:08:50.638855 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b3f451c7-55bc-44b5-a934-89f0b55d60a4 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:50.639499 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b3f451c7-55bc-44b5-a934-89f0b55d60a4 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:50.645419 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b3f451c7-55bc-44b5-a934-89f0b55d60a4 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:50.646362 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b3f451c7-55bc-44b5-a934-89f0b55d60a4 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:50.647123 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b3f451c7-55bc-44b5-a934-89f0b55d60a4 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:50.647584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b3f451c7-55bc-44b5-a934-89f0b55d60a4 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:50.779882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b3f451c7-55bc-44b5-a934-89f0b55d60a4 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:50.787863 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b3f451c7-55bc-44b5-a934-89f0b55d60a4 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd" status: 200 len: 1513 microversion: 2.1 time: 0.154209 May 19 15:08:50.788450 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 179/354] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:50 2022] GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:50.936310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f7ec742e-3128-48dd-affd-e35f5dd9875d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:50.937048 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f7ec742e-3128-48dd-affd-e35f5dd9875d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:50.943628 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7ec742e-3128-48dd-affd-e35f5dd9875d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:50.944085 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7ec742e-3128-48dd-affd-e35f5dd9875d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:50.944850 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7ec742e-3128-48dd-affd-e35f5dd9875d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:50.945289 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7ec742e-3128-48dd-affd-e35f5dd9875d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:51.072943 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f7ec742e-3128-48dd-affd-e35f5dd9875d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:51.081269 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f7ec742e-3128-48dd-affd-e35f5dd9875d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:51.082764 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f7ec742e-3128-48dd-affd-e35f5dd9875d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:51.084736 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f7ec742e-3128-48dd-affd-e35f5dd9875d tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.152572 May 19 15:08:51.085225 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 176/355] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:50 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:51.319849 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-38ae4b82-b37a-4aa8-a522-76d39447518a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:51.320463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-38ae4b82-b37a-4aa8-a522-76d39447518a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:51.327105 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38ae4b82-b37a-4aa8-a522-76d39447518a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:51.327597 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38ae4b82-b37a-4aa8-a522-76d39447518a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:51.328373 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38ae4b82-b37a-4aa8-a522-76d39447518a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:51.328817 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-38ae4b82-b37a-4aa8-a522-76d39447518a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:51.455331 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-38ae4b82-b37a-4aa8-a522-76d39447518a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:51.462960 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-38ae4b82-b37a-4aa8-a522-76d39447518a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.146998 May 19 15:08:51.463573 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 180/356] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:51 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:51.616511 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-7b87b807-da83-4a06-b124-39eaace31ae3 req-f9568e08-03bb-4c9e-a6da-4206f3b3db9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43fdf07-dfad-4813-9f02-1de4e886eb18", "name": "network-vif-plugged", "status": "completed", "tag": "6d4f2f1d-bc4f-469b-a086-62fc903f5044"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:08:51.624970 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-7b87b807-da83-4a06-b124-39eaace31ae3 req-f9568e08-03bb-4c9e-a6da-4206f3b3db9f service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:51.625426 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-7b87b807-da83-4a06-b124-39eaace31ae3 req-f9568e08-03bb-4c9e-a6da-4206f3b3db9f service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:51.636246 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-7b87b807-da83-4a06-b124-39eaace31ae3 req-f9568e08-03bb-4c9e-a6da-4206f3b3db9f service nova] Creating event network-vif-plugged:6d4f2f1d-bc4f-469b-a086-62fc903f5044 for instance a43fdf07-dfad-4813-9f02-1de4e886eb18 on hv-cinder-82549 May 19 15:08:51.640963 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-7b87b807-da83-4a06-b124-39eaace31ae3 req-f9568e08-03bb-4c9e-a6da-4206f3b3db9f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028092 May 19 15:08:51.641556 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 177/357] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:08:51.804892 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-42b594be-a9e1-4736-8cc1-e4454fab1a0d tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:51.805495 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-42b594be-a9e1-4736-8cc1-e4454fab1a0d tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:51.811491 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-42b594be-a9e1-4736-8cc1-e4454fab1a0d tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:51.811941 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-42b594be-a9e1-4736-8cc1-e4454fab1a0d tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:51.812691 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-42b594be-a9e1-4736-8cc1-e4454fab1a0d tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:51.813124 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-42b594be-a9e1-4736-8cc1-e4454fab1a0d tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:51.943428 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-42b594be-a9e1-4736-8cc1-e4454fab1a0d tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:51.950896 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-42b594be-a9e1-4736-8cc1-e4454fab1a0d tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd" status: 200 len: 1513 microversion: 2.1 time: 0.149863 May 19 15:08:51.951491 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 181/358] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:51 2022] GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:52.103182 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-dc1e53b2-82c6-4bb3-9e83-bb1d58b8cb58 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:52.103908 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-dc1e53b2-82c6-4bb3-9e83-bb1d58b8cb58 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:52.110165 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-dc1e53b2-82c6-4bb3-9e83-bb1d58b8cb58 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:52.110643 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-dc1e53b2-82c6-4bb3-9e83-bb1d58b8cb58 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:52.111438 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-dc1e53b2-82c6-4bb3-9e83-bb1d58b8cb58 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:52.111877 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-dc1e53b2-82c6-4bb3-9e83-bb1d58b8cb58 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:52.240478 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-dc1e53b2-82c6-4bb3-9e83-bb1d58b8cb58 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:52.250227 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-dc1e53b2-82c6-4bb3-9e83-bb1d58b8cb58 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:52.251765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-dc1e53b2-82c6-4bb3-9e83-bb1d58b8cb58 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:52.252935 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-dc1e53b2-82c6-4bb3-9e83-bb1d58b8cb58 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.154589 May 19 15:08:52.253496 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 178/359] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:52 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:52.480179 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8186be0d-1b96-4fef-bbc0-d4549fb75012 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:52.480834 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8186be0d-1b96-4fef-bbc0-d4549fb75012 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:52.487368 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8186be0d-1b96-4fef-bbc0-d4549fb75012 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:52.487855 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8186be0d-1b96-4fef-bbc0-d4549fb75012 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:52.488658 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8186be0d-1b96-4fef-bbc0-d4549fb75012 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:52.489100 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8186be0d-1b96-4fef-bbc0-d4549fb75012 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:52.623311 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8186be0d-1b96-4fef-bbc0-d4549fb75012 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:52.630801 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8186be0d-1b96-4fef-bbc0-d4549fb75012 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.154553 May 19 15:08:52.631403 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 182/360] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:52 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:52.968309 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-febaa4e3-c37a-46da-a3b0-931e71b3a2fe tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:52.968924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-febaa4e3-c37a-46da-a3b0-931e71b3a2fe tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:52.975610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-febaa4e3-c37a-46da-a3b0-931e71b3a2fe tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:52.976063 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-febaa4e3-c37a-46da-a3b0-931e71b3a2fe tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:52.976833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-febaa4e3-c37a-46da-a3b0-931e71b3a2fe tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:52.977271 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-febaa4e3-c37a-46da-a3b0-931e71b3a2fe tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:53.106116 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-febaa4e3-c37a-46da-a3b0-931e71b3a2fe tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:53.113810 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-febaa4e3-c37a-46da-a3b0-931e71b3a2fe tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd" status: 200 len: 1513 microversion: 2.1 time: 0.149282 May 19 15:08:53.115039 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 179/361] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:52 2022] GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:53.271798 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-81a6b6e3-5c32-4d70-a6fb-32615d636764 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:53.272337 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-81a6b6e3-5c32-4d70-a6fb-32615d636764 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:53.278382 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-81a6b6e3-5c32-4d70-a6fb-32615d636764 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:53.278838 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-81a6b6e3-5c32-4d70-a6fb-32615d636764 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:53.279638 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-81a6b6e3-5c32-4d70-a6fb-32615d636764 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:53.280081 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-81a6b6e3-5c32-4d70-a6fb-32615d636764 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:53.414167 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-c3243f2c-ea10-4da0-9b7f-22f92369262d req-ecd8e887-b070-4bfd-a908-281e58cb85f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abfb9153-3ce0-4a77-bcaf-ff150167e0cd", "name": "network-vif-deleted", "tag": "8dce6e6e-d156-430b-8f9c-e219fc9db6df"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:08:53.419349 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-81a6b6e3-5c32-4d70-a6fb-32615d636764 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:53.423041 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-c3243f2c-ea10-4da0-9b7f-22f92369262d req-ecd8e887-b070-4bfd-a908-281e58cb85f4 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:53.423740 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-c3243f2c-ea10-4da0-9b7f-22f92369262d req-ecd8e887-b070-4bfd-a908-281e58cb85f4 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:53.437281 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-81a6b6e3-5c32-4d70-a6fb-32615d636764 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:53.437767 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-c3243f2c-ea10-4da0-9b7f-22f92369262d req-ecd8e887-b070-4bfd-a908-281e58cb85f4 service nova] Creating event network-vif-deleted:8dce6e6e-d156-430b-8f9c-e219fc9db6df for instance abfb9153-3ce0-4a77-bcaf-ff150167e0cd on hv-cinder-82549 May 19 15:08:53.439032 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-81a6b6e3-5c32-4d70-a6fb-32615d636764 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:53.440396 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-81a6b6e3-5c32-4d70-a6fb-32615d636764 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.173236 May 19 15:08:53.447252 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 183/362] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:53 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:53.447815 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-c3243f2c-ea10-4da0-9b7f-22f92369262d req-ecd8e887-b070-4bfd-a908-281e58cb85f4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033275 May 19 15:08:53.447815 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 180/363] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:08:53.648270 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b4f3ba4e-b1d6-49d2-8e5c-8192ef0a57e1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:53.648899 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b4f3ba4e-b1d6-49d2-8e5c-8192ef0a57e1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:53.655465 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b4f3ba4e-b1d6-49d2-8e5c-8192ef0a57e1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:53.655926 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b4f3ba4e-b1d6-49d2-8e5c-8192ef0a57e1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:53.656696 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b4f3ba4e-b1d6-49d2-8e5c-8192ef0a57e1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:53.657143 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b4f3ba4e-b1d6-49d2-8e5c-8192ef0a57e1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:53.795713 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b4f3ba4e-b1d6-49d2-8e5c-8192ef0a57e1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:53.803897 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b4f3ba4e-b1d6-49d2-8e5c-8192ef0a57e1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1267 microversion: 2.1 time: 0.160072 May 19 15:08:53.804472 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 184/364] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:53 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:08:54.134942 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-cd568d1f-8f19-42de-b932-d4837ffb4d23 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:54.135685 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-cd568d1f-8f19-42de-b932-d4837ffb4d23 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:54.142359 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cd568d1f-8f19-42de-b932-d4837ffb4d23 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:54.142811 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cd568d1f-8f19-42de-b932-d4837ffb4d23 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:54.143613 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cd568d1f-8f19-42de-b932-d4837ffb4d23 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:54.144050 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cd568d1f-8f19-42de-b932-d4837ffb4d23 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:54.174081 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cd568d1f-8f19-42de-b932-d4837ffb4d23 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:54.174529 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cd568d1f-8f19-42de-b932-d4837ffb4d23 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:54.174974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-cd568d1f-8f19-42de-b932-d4837ffb4d23 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lazy-loading 'fault' on Instance uuid abfb9153-3ce0-4a77-bcaf-ff150167e0cd {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:08:54.177726 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:54.218813 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-cd568d1f-8f19-42de-b932-d4837ffb4d23 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:54.235607 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-cd568d1f-8f19-42de-b932-d4837ffb4d23 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd" status: 200 len: 1307 microversion: 2.1 time: 0.104822 May 19 15:08:54.236171 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 181/365] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:54 2022] GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd => generated 1307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:54.459784 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e66ff32a-f6cf-43b3-9af1-f6bb070ca155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:54.460398 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e66ff32a-f6cf-43b3-9af1-f6bb070ca155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:54.466446 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e66ff32a-f6cf-43b3-9af1-f6bb070ca155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:54.466902 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e66ff32a-f6cf-43b3-9af1-f6bb070ca155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:54.467696 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e66ff32a-f6cf-43b3-9af1-f6bb070ca155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:54.468141 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e66ff32a-f6cf-43b3-9af1-f6bb070ca155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:54.611586 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e66ff32a-f6cf-43b3-9af1-f6bb070ca155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:54.620520 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e66ff32a-f6cf-43b3-9af1-f6bb070ca155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:54.622021 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e66ff32a-f6cf-43b3-9af1-f6bb070ca155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:54.623182 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e66ff32a-f6cf-43b3-9af1-f6bb070ca155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.167871 May 19 15:08:54.623774 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 185/366] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:54 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:54.821513 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a19a4acf-0c5c-4f14-a630-2001b63aea38 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:54.822128 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-a19a4acf-0c5c-4f14-a630-2001b63aea38 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:54.828454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a19a4acf-0c5c-4f14-a630-2001b63aea38 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:54.828910 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a19a4acf-0c5c-4f14-a630-2001b63aea38 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:54.829675 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a19a4acf-0c5c-4f14-a630-2001b63aea38 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:54.830131 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a19a4acf-0c5c-4f14-a630-2001b63aea38 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:54.958988 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-a19a4acf-0c5c-4f14-a630-2001b63aea38 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:54.966516 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-a19a4acf-0c5c-4f14-a630-2001b63aea38 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1453 microversion: 2.1 time: 0.149364 May 19 15:08:54.967088 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 182/367] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:54 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:54.983079 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-96e2c4d6-4b1f-4f03-bc28-59ea5b484db7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:54.983715 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-96e2c4d6-4b1f-4f03-bc28-59ea5b484db7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:54.990091 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-96e2c4d6-4b1f-4f03-bc28-59ea5b484db7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:54.990547 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-96e2c4d6-4b1f-4f03-bc28-59ea5b484db7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:54.991341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-96e2c4d6-4b1f-4f03-bc28-59ea5b484db7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:54.991790 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-96e2c4d6-4b1f-4f03-bc28-59ea5b484db7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:55.123161 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-96e2c4d6-4b1f-4f03-bc28-59ea5b484db7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:55.131325 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-96e2c4d6-4b1f-4f03-bc28-59ea5b484db7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1453 microversion: 2.1 time: 0.152048 May 19 15:08:55.131906 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 186/368] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:54 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:08:55.253424 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7c17dc92-f2ca-4d28-9652-9c7f043b388b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:55.254042 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7c17dc92-f2ca-4d28-9652-9c7f043b388b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: abfb9153-3ce0-4a77-bcaf-ff150167e0cd] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:55.260510 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7c17dc92-f2ca-4d28-9652-9c7f043b388b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:55.260962 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7c17dc92-f2ca-4d28-9652-9c7f043b388b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:55.261729 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7c17dc92-f2ca-4d28-9652-9c7f043b388b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:55.262166 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7c17dc92-f2ca-4d28-9652-9c7f043b388b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:55.275969 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-7c17dc92-f2ca-4d28-9652-9c7f043b388b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] HTTP exception thrown: Instance abfb9153-3ce0-4a77-bcaf-ff150167e0cd could not be found. May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7c17dc92-f2ca-4d28-9652-9c7f043b388b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Request method failure captured: May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd HTTP/1.1 May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihl03bRgvXTc4FRSVw0vnlNrtcLWbMzfXGnQTNSrnwamE1jLMwlDHLLQDaZdx2gEapr4ik-2ungWyaaaJ0mg9TTmSRV1cSIJ6pVup4H9-t-hfDZnepu8cyVs525ITgwZnRF-1EScL-4-OmACSF81AT0LB3yLK-ouZ-c0V2sogAx2AtJY May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 8f7a1fc211304ed3a001282402fa73cc May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2145419031 May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:08:55.277600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:08:55.278972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8f7a1fc211304ed3a001282402fa73cc", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8f7a1fc211304ed3a001282402fa73cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8f7a1fc211304ed3a001282402fa73cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8f7a1fc211304ed3a001282402fa73cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:08:55.278972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-VolumesSnapshotTestJSON-2145419031 May 19 15:08:55.278972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 8f7a1fc211304ed3a001282402fa73cc May 19 15:08:55.278972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2145419031 May 19 15:08:55.278972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-VolumesSnapshotTestJSON-2145419031-project May 19 15:08:55.278972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:08:55.278972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:08:55.278972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: f7d796b832c442c0a2af8ef603879f30 May 19 15:08:55.278972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-VolumesSnapshotTestJSON-2145419031-project May 19 15:08:55.278972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:08:55.278972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance abfb9153-3ce0-4a77-bcaf-ff150167e0cd could not be found. May 19 15:08:55.278972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': 'abfb9153-3ce0-4a77-bcaf-ff150167e0cd'} May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abfb9153-3ce0-4a77-bcaf-ff150167e0cd could not be found. May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:08:55.280028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abfb9153-3ce0-4a77-bcaf-ff150167e0cd could not be found. May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abfb9153-3ce0-4a77-bcaf-ff150167e0cd could not be found. May 19 15:08:55.281490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:08:55.282858 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7c17dc92-f2ca-4d28-9652-9c7f043b388b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Returning 404 to user: Instance abfb9153-3ce0-4a77-bcaf-ff150167e0cd could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:08:55.282858 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7c17dc92-f2ca-4d28-9652-9c7f043b388b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd" status: 404 len: 111 microversion: 2.1 time: 0.029556 May 19 15:08:55.283583 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 183/369] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:08:55 2022] GET /compute/v2.1/servers/abfb9153-3ce0-4a77-bcaf-ff150167e0cd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:08:55.641913 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e756a32c-f3f4-4f64-ad6e-5e233a38fda8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:55.642516 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e756a32c-f3f4-4f64-ad6e-5e233a38fda8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:55.658737 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e756a32c-f3f4-4f64-ad6e-5e233a38fda8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:55.659193 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e756a32c-f3f4-4f64-ad6e-5e233a38fda8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:55.659989 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e756a32c-f3f4-4f64-ad6e-5e233a38fda8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:55.660428 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e756a32c-f3f4-4f64-ad6e-5e233a38fda8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:55.664957 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:55.802253 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e756a32c-f3f4-4f64-ad6e-5e233a38fda8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:55.810701 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e756a32c-f3f4-4f64-ad6e-5e233a38fda8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:55.812321 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e756a32c-f3f4-4f64-ad6e-5e233a38fda8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:55.813485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e756a32c-f3f4-4f64-ad6e-5e233a38fda8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.175501 May 19 15:08:55.814046 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 187/370] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:55 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:56.832113 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ac7f0de2-94f7-4106-9b3c-29a2826480ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:56.832759 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ac7f0de2-94f7-4106-9b3c-29a2826480ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:56.839675 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ac7f0de2-94f7-4106-9b3c-29a2826480ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:56.840135 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ac7f0de2-94f7-4106-9b3c-29a2826480ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:56.840924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ac7f0de2-94f7-4106-9b3c-29a2826480ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:56.841368 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ac7f0de2-94f7-4106-9b3c-29a2826480ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:56.975450 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ac7f0de2-94f7-4106-9b3c-29a2826480ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:56.984191 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ac7f0de2-94f7-4106-9b3c-29a2826480ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:56.985691 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ac7f0de2-94f7-4106-9b3c-29a2826480ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:56.986852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ac7f0de2-94f7-4106-9b3c-29a2826480ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.158720 May 19 15:08:56.987461 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 184/371] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:56 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:57.072671 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-6d7eba62-910a-41c8-bfc8-b863ef177364 req-4b0a7962-842a-4381-b34e-0b42e554a65f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a43fdf07-dfad-4813-9f02-1de4e886eb18", "tag": "6d4f2f1d-bc4f-469b-a086-62fc903f5044"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:08:57.076906 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=62 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:08:57.082596 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-6d7eba62-910a-41c8-bfc8-b863ef177364 req-4b0a7962-842a-4381-b34e-0b42e554a65f service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:57.083045 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-6d7eba62-910a-41c8-bfc8-b863ef177364 req-4b0a7962-842a-4381-b34e-0b42e554a65f service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:57.094013 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-6d7eba62-910a-41c8-bfc8-b863ef177364 req-4b0a7962-842a-4381-b34e-0b42e554a65f service nova] Creating event network-changed:6d4f2f1d-bc4f-469b-a086-62fc903f5044 for instance a43fdf07-dfad-4813-9f02-1de4e886eb18 on hv-cinder-82549 May 19 15:08:57.100531 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-6d7eba62-910a-41c8-bfc8-b863ef177364 req-4b0a7962-842a-4381-b34e-0b42e554a65f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031574 May 19 15:08:57.101146 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 188/372] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:08:58.005846 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7cc49b8c-8b67-4d56-a738-61cd21f1e7af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:58.006413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7cc49b8c-8b67-4d56-a738-61cd21f1e7af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:58.012910 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7cc49b8c-8b67-4d56-a738-61cd21f1e7af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:58.013365 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7cc49b8c-8b67-4d56-a738-61cd21f1e7af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:58.014141 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7cc49b8c-8b67-4d56-a738-61cd21f1e7af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:58.014583 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7cc49b8c-8b67-4d56-a738-61cd21f1e7af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:58.148958 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7cc49b8c-8b67-4d56-a738-61cd21f1e7af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:58.157702 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7cc49b8c-8b67-4d56-a738-61cd21f1e7af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:58.159191 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7cc49b8c-8b67-4d56-a738-61cd21f1e7af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:58.160364 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7cc49b8c-8b67-4d56-a738-61cd21f1e7af tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.158561 May 19 15:08:58.161570 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 185/373] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:58 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:08:59.180129 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a907a19e-874a-49e5-9041-f61d9a1ad589 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:08:59.180863 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a907a19e-874a-49e5-9041-f61d9a1ad589 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:08:59.187049 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a907a19e-874a-49e5-9041-f61d9a1ad589 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:59.187549 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a907a19e-874a-49e5-9041-f61d9a1ad589 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:59.188317 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a907a19e-874a-49e5-9041-f61d9a1ad589 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:08:59.188788 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a907a19e-874a-49e5-9041-f61d9a1ad589 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:08:59.320370 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a907a19e-874a-49e5-9041-f61d9a1ad589 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:59.328906 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a907a19e-874a-49e5-9041-f61d9a1ad589 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:59.330417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a907a19e-874a-49e5-9041-f61d9a1ad589 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:08:59.331614 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a907a19e-874a-49e5-9041-f61d9a1ad589 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.156373 May 19 15:08:59.332190 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 189/374] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:08:59 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:09:00.042465 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-b973d9c4-6e30-4817-9b87-c711a71d5cea req-15764140-694d-475f-a4a7-eae70174be77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6324753a-5912-42c2-a1f4-0bc631bea605", "name": "network-vif-plugged", "status": "completed", "tag": "3beaa750-59c9-4ce6-b188-390d70f3fb7a"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:00.051794 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-b973d9c4-6e30-4817-9b87-c711a71d5cea req-15764140-694d-475f-a4a7-eae70174be77 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:00.052243 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-b973d9c4-6e30-4817-9b87-c711a71d5cea req-15764140-694d-475f-a4a7-eae70174be77 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:00.063428 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-b973d9c4-6e30-4817-9b87-c711a71d5cea req-15764140-694d-475f-a4a7-eae70174be77 service nova] Creating event network-vif-plugged:3beaa750-59c9-4ce6-b188-390d70f3fb7a for instance 6324753a-5912-42c2-a1f4-0bc631bea605 on hv-cinder-82549 May 19 15:09:00.068911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-b973d9c4-6e30-4817-9b87-c711a71d5cea req-15764140-694d-475f-a4a7-eae70174be77 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030194 May 19 15:09:00.069499 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 186/375] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:09:00.349790 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-74b7b618-c1b4-4a78-9bd4-91599779777c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:00.350404 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-74b7b618-c1b4-4a78-9bd4-91599779777c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:00.356945 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-74b7b618-c1b4-4a78-9bd4-91599779777c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:00.357398 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-74b7b618-c1b4-4a78-9bd4-91599779777c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:00.358164 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-74b7b618-c1b4-4a78-9bd4-91599779777c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:00.358604 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-74b7b618-c1b4-4a78-9bd4-91599779777c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:00.491816 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-74b7b618-c1b4-4a78-9bd4-91599779777c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:00.500391 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-74b7b618-c1b4-4a78-9bd4-91599779777c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:00.501874 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-74b7b618-c1b4-4a78-9bd4-91599779777c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:00.503012 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-74b7b618-c1b4-4a78-9bd4-91599779777c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.157146 May 19 15:09:00.503606 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 190/376] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:09:00 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:09:01.523348 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f5f92e3f-6048-4e75-b14b-f4cf1e3a39a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:01.524047 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f5f92e3f-6048-4e75-b14b-f4cf1e3a39a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:01.530252 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f5f92e3f-6048-4e75-b14b-f4cf1e3a39a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:01.530711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f5f92e3f-6048-4e75-b14b-f4cf1e3a39a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:01.531513 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f5f92e3f-6048-4e75-b14b-f4cf1e3a39a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:01.531959 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f5f92e3f-6048-4e75-b14b-f4cf1e3a39a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:01.659016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f5f92e3f-6048-4e75-b14b-f4cf1e3a39a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:01.667362 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f5f92e3f-6048-4e75-b14b-f4cf1e3a39a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:01.668861 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f5f92e3f-6048-4e75-b14b-f4cf1e3a39a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:01.670016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f5f92e3f-6048-4e75-b14b-f4cf1e3a39a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.152352 May 19 15:09:01.670963 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 187/377] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:09:01 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:09:02.688486 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-793158fe-5479-4668-9d32-75f79911a7d6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:02.689126 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-793158fe-5479-4668-9d32-75f79911a7d6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:02.696326 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-793158fe-5479-4668-9d32-75f79911a7d6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:02.696779 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-793158fe-5479-4668-9d32-75f79911a7d6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:02.697547 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-793158fe-5479-4668-9d32-75f79911a7d6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:02.697991 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-793158fe-5479-4668-9d32-75f79911a7d6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:02.826773 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-793158fe-5479-4668-9d32-75f79911a7d6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:02.835102 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-793158fe-5479-4668-9d32-75f79911a7d6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:02.836634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-793158fe-5479-4668-9d32-75f79911a7d6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:02.837793 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-793158fe-5479-4668-9d32-75f79911a7d6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.153220 May 19 15:09:02.838355 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 191/378] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:09:02 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:09:03.855972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c3acdbd7-8930-4be4-bd77-19daf067e66a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:03.856589 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c3acdbd7-8930-4be4-bd77-19daf067e66a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:03.859165 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:03.865695 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c3acdbd7-8930-4be4-bd77-19daf067e66a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:03.866152 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c3acdbd7-8930-4be4-bd77-19daf067e66a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:03.866925 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c3acdbd7-8930-4be4-bd77-19daf067e66a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:03.867401 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c3acdbd7-8930-4be4-bd77-19daf067e66a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:03.992987 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c3acdbd7-8930-4be4-bd77-19daf067e66a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:04.001592 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c3acdbd7-8930-4be4-bd77-19daf067e66a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:04.003103 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c3acdbd7-8930-4be4-bd77-19daf067e66a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:04.004287 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c3acdbd7-8930-4be4-bd77-19daf067e66a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.152232 May 19 15:09:04.004847 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 188/379] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:09:03 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:09:04.166475 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-70388741", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "networks": [{"uuid": "caae226b-eb30-4cc3-81ca-a5536dcb8101"}]}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:04.217800 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] validate_networks() for [('caae226b-eb30-4cc3-81ca-a5536dcb8101', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:09:04.579012 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:09:04.579469 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:09:04.579950 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:09:04.580363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:09:04.580778 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:09:04.590378 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:04.590831 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:04.591689 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:04.592136 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:04.609254 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Getting quotas for project 8f7a1fc211304ed3a001282402fa73cc. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:09:04.613183 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Getting quotas for user f7d796b832c442c0a2af8ef603879f30 and project 8f7a1fc211304ed3a001282402fa73cc. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:09:04.624433 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:09:04.626671 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:09:04.671242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-07e7dfe9-4cbb-4989-999b-5a40d3351f42 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509606 May 19 15:09:04.671835 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 192/380] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:09:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:09:04.681593 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6fb55a8f-6cfe-436a-927d-7aea61b5ba2a tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:04.682210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-6fb55a8f-6cfe-436a-927d-7aea61b5ba2a tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:04.735452 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6fb55a8f-6cfe-436a-927d-7aea61b5ba2a tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:04.742125 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6fb55a8f-6cfe-436a-927d-7aea61b5ba2a tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 200 len: 1217 microversion: 2.1 time: 0.064374 May 19 15:09:04.742687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 189/381] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:04 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:05.024881 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a70274f7-f759-4b78-9ca7-3627c6075eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:05.025502 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a70274f7-f759-4b78-9ca7-3627c6075eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:05.033113 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a70274f7-f759-4b78-9ca7-3627c6075eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:05.033606 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a70274f7-f759-4b78-9ca7-3627c6075eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:05.034377 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a70274f7-f759-4b78-9ca7-3627c6075eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:05.034811 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a70274f7-f759-4b78-9ca7-3627c6075eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:05.190047 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a70274f7-f759-4b78-9ca7-3627c6075eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:05.200321 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a70274f7-f759-4b78-9ca7-3627c6075eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:05.202103 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a70274f7-f759-4b78-9ca7-3627c6075eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:05.203990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a70274f7-f759-4b78-9ca7-3627c6075eb1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1808 microversion: 2.20 time: 0.183042 May 19 15:09:05.205052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 193/382] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:09:05 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:09:05.759665 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-265c9000-e5e9-4ec2-8f54-f8f6bd6fdb78 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:05.760383 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-265c9000-e5e9-4ec2-8f54-f8f6bd6fdb78 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:05.768545 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-265c9000-e5e9-4ec2-8f54-f8f6bd6fdb78 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:05.769275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-265c9000-e5e9-4ec2-8f54-f8f6bd6fdb78 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:05.770342 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-265c9000-e5e9-4ec2-8f54-f8f6bd6fdb78 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:05.771460 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-265c9000-e5e9-4ec2-8f54-f8f6bd6fdb78 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:05.843872 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-265c9000-e5e9-4ec2-8f54-f8f6bd6fdb78 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:05.852166 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-265c9000-e5e9-4ec2-8f54-f8f6bd6fdb78 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 200 len: 1287 microversion: 2.1 time: 0.096925 May 19 15:09:05.852771 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 190/383] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:05 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 1287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:06.222065 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f17f18f9-0ad0-4f51-b55c-32dd70939aea tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:06.222684 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f17f18f9-0ad0-4f51-b55c-32dd70939aea tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:06.229157 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f17f18f9-0ad0-4f51-b55c-32dd70939aea tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:06.229615 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f17f18f9-0ad0-4f51-b55c-32dd70939aea tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:06.230381 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f17f18f9-0ad0-4f51-b55c-32dd70939aea tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:06.230829 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f17f18f9-0ad0-4f51-b55c-32dd70939aea tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:06.363193 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f17f18f9-0ad0-4f51-b55c-32dd70939aea tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:06.373211 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f17f18f9-0ad0-4f51-b55c-32dd70939aea tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:06.374985 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f17f18f9-0ad0-4f51-b55c-32dd70939aea tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:06.376359 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f17f18f9-0ad0-4f51-b55c-32dd70939aea tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1795 microversion: 2.20 time: 0.158312 May 19 15:09:06.377030 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 194/384] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:09:06 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1795 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:09:06.870276 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4cee7d00-a992-4574-a9c4-1e4665557378 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:06.870805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4cee7d00-a992-4574-a9c4-1e4665557378 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:06.877329 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4cee7d00-a992-4574-a9c4-1e4665557378 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:06.877794 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4cee7d00-a992-4574-a9c4-1e4665557378 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:06.878571 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4cee7d00-a992-4574-a9c4-1e4665557378 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:06.879009 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4cee7d00-a992-4574-a9c4-1e4665557378 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:07.005117 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-f9210b18-520a-4fa2-8e2f-f73f6b725fce req-3de7b0e1-986e-412a-bf7c-0c80e8dcaf4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4c1217-82c6-4ffa-bb29-2ab78d048fe4", "tag": "5f35a1f9-3029-4da3-9b81-244b3026f32a"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:07.013814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-f9210b18-520a-4fa2-8e2f-f73f6b725fce req-3de7b0e1-986e-412a-bf7c-0c80e8dcaf4c service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:07.014498 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-f9210b18-520a-4fa2-8e2f-f73f6b725fce req-3de7b0e1-986e-412a-bf7c-0c80e8dcaf4c service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:07.015672 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4cee7d00-a992-4574-a9c4-1e4665557378 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:07.025887 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4cee7d00-a992-4574-a9c4-1e4665557378 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 200 len: 1317 microversion: 2.1 time: 0.159418 May 19 15:09:07.027000 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 191/385] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:06 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:07.031617 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-f9210b18-520a-4fa2-8e2f-f73f6b725fce req-3de7b0e1-986e-412a-bf7c-0c80e8dcaf4c service nova] Creating event network-changed:5f35a1f9-3029-4da3-9b81-244b3026f32a for instance 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 on hv-cinder-82549 May 19 15:09:07.038067 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-f9210b18-520a-4fa2-8e2f-f73f6b725fce req-3de7b0e1-986e-412a-bf7c-0c80e8dcaf4c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036612 May 19 15:09:07.038659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 195/386] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:09:07.619854 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-fc65ae78-f7cb-486d-b7ca-5d121242f514 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:07.620341 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-fc65ae78-f7cb-486d-b7ca-5d121242f514 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:07.626314 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fc65ae78-f7cb-486d-b7ca-5d121242f514 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:07.626761 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fc65ae78-f7cb-486d-b7ca-5d121242f514 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:07.627561 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fc65ae78-f7cb-486d-b7ca-5d121242f514 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:07.627994 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fc65ae78-f7cb-486d-b7ca-5d121242f514 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:07.650949 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-fc65ae78-f7cb-486d-b7ca-5d121242f514 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca/ips" status: 200 len: 149 microversion: 2.1 time: 0.035219 May 19 15:09:07.651519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 192/387] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 15:09:07 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:09:07.662822 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f4e3979b-2159-42fb-949b-40c42fc6ada1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67697683-0e47-4b4b-b016-2bd493adc6b6"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:07.664099 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f4e3979b-2159-42fb-949b-40c42fc6ada1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:07.670433 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f4e3979b-2159-42fb-949b-40c42fc6ada1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:07.670827 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f4e3979b-2159-42fb-949b-40c42fc6ada1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:07.671626 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f4e3979b-2159-42fb-949b-40c42fc6ada1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:07.672068 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f4e3979b-2159-42fb-949b-40c42fc6ada1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:07.753352 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-f4e3979b-2159-42fb-949b-40c42fc6ada1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] HTTP exception thrown: Invalid volume: volume 67697683-0e47-4b4b-b016-2bd493adc6b6 is already attached to instances: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f4e3979b-2159-42fb-949b-40c42fc6ada1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Request method failure captured: May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: POST /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca/os-volume_attachments HTTP/1.1 May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 74 May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihlzC36TVjbhLtU3g9xMp125AwUSov1duWZll1n5H-S_HScG7MruR7Gs1GViXAQd0SIJut8uotHNInm1_M2FBmXP1RayH0EJZ45YHoedSq6oTnynPABMFxjsri0-n9qTagsLk52YqxiHKDUiWNSXW6fHPq-ckGn5xy8R26VrSRWiq2XI May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:09:07.755595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:09:07.757043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_34c1099557144b8bb2fff88f5b526834", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:09:07.757043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:09:07.757043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:09:07.757043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:09:07.757043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:09:07.757043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:09:07.757043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:09:07.757043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: af7838e525a042dfa0357ad1fc58cf21 May 19 15:09:07.757043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:09:07.757043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: May 19 15:09:07.757043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {"volumeAttachment": {"volumeId": "67697683-0e47-4b4b-b016-2bd493adc6b6"}} May 19 15:09:07.757043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Invalid volume: volume 67697683-0e47-4b4b-b016-2bd493adc6b6 is already attached to instances: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'server_id': '2b9c3778-68d3-440a-b89c-22cf3a93baca', 'body': {'volumeAttachment': {'volumeId': '67697683-0e47-4b4b-b016-2bd493adc6b6'}}} May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 67697683-0e47-4b4b-b016-2bd493adc6b6 is already attached to instances: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:07.758055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 67697683-0e47-4b4b-b016-2bd493adc6b6 is already attached to instances: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:07.759435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:09:07.760798 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:09:07.760798 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:09:07.760798 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:09:07.760798 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 67697683-0e47-4b4b-b016-2bd493adc6b6 is already attached to instances: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 May 19 15:09:07.760798 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:07.760798 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f4e3979b-2159-42fb-949b-40c42fc6ada1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Returning 400 to user: Invalid volume: volume 67697683-0e47-4b4b-b016-2bd493adc6b6 is already attached to instances: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:09:07.760798 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f4e3979b-2159-42fb-949b-40c42fc6ada1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "POST /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099080 May 19 15:09:07.760798 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 196/388] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 15:09:07 2022] POST /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 15:09:07.765860 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-15b2e3f7-1a6d-4ba4-96a5-9f50f5ccb0c1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:07.766362 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-15b2e3f7-1a6d-4ba4-96a5-9f50f5ccb0c1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:07.773064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-15b2e3f7-1a6d-4ba4-96a5-9f50f5ccb0c1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:07.773519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-15b2e3f7-1a6d-4ba4-96a5-9f50f5ccb0c1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:07.774292 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-15b2e3f7-1a6d-4ba4-96a5-9f50f5ccb0c1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:07.774733 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-15b2e3f7-1a6d-4ba4-96a5-9f50f5ccb0c1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:07.798932 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-15b2e3f7-1a6d-4ba4-96a5-9f50f5ccb0c1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Going to try to terminate instance {{(pid=117445) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:09:07.871790 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-15b2e3f7-1a6d-4ba4-96a5-9f50f5ccb0c1 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "DELETE /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 204 len: 0 microversion: 2.1 time: 0.109387 May 19 15:09:07.872405 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 193/389] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:09:07 2022] DELETE /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:09:07.880936 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b5151fb0-8baf-4b19-b0c2-6ce9ae08d276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:07.881553 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b5151fb0-8baf-4b19-b0c2-6ce9ae08d276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:07.887499 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b5151fb0-8baf-4b19-b0c2-6ce9ae08d276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:07.887954 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b5151fb0-8baf-4b19-b0c2-6ce9ae08d276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:07.888729 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b5151fb0-8baf-4b19-b0c2-6ce9ae08d276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:07.889185 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b5151fb0-8baf-4b19-b0c2-6ce9ae08d276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:08.013897 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b5151fb0-8baf-4b19-b0c2-6ce9ae08d276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:08.021382 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b5151fb0-8baf-4b19-b0c2-6ce9ae08d276 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1680 microversion: 2.1 time: 0.144794 May 19 15:09:08.021932 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 197/390] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:07 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1680 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:08.043222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f0a6b677-5702-4ffc-afbc-382a4ffcc361 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:08.043925 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f0a6b677-5702-4ffc-afbc-382a4ffcc361 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:08.050517 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f0a6b677-5702-4ffc-afbc-382a4ffcc361 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:08.050978 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f0a6b677-5702-4ffc-afbc-382a4ffcc361 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:08.052286 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f0a6b677-5702-4ffc-afbc-382a4ffcc361 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:08.052762 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f0a6b677-5702-4ffc-afbc-382a4ffcc361 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:08.184411 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f0a6b677-5702-4ffc-afbc-382a4ffcc361 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:08.191791 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f0a6b677-5702-4ffc-afbc-382a4ffcc361 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 200 len: 1317 microversion: 2.1 time: 0.152725 May 19 15:09:08.192929 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 194/391] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:08 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:09.040266 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d29ecf8c-d8d8-4c60-8635-48e7022a3565 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:09.040888 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d29ecf8c-d8d8-4c60-8635-48e7022a3565 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:09.047449 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d29ecf8c-d8d8-4c60-8635-48e7022a3565 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:09.047912 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d29ecf8c-d8d8-4c60-8635-48e7022a3565 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:09.048682 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d29ecf8c-d8d8-4c60-8635-48e7022a3565 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:09.049123 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d29ecf8c-d8d8-4c60-8635-48e7022a3565 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:09.174568 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d29ecf8c-d8d8-4c60-8635-48e7022a3565 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:09.182594 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d29ecf8c-d8d8-4c60-8635-48e7022a3565 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1680 microversion: 2.1 time: 0.146741 May 19 15:09:09.183144 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 198/392] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:09 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:09.208112 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-59679111-bc74-4bd1-847d-804decef8e94 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:09.208715 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-59679111-bc74-4bd1-847d-804decef8e94 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:09.214700 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-59679111-bc74-4bd1-847d-804decef8e94 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:09.215146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-59679111-bc74-4bd1-847d-804decef8e94 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:09.215926 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-59679111-bc74-4bd1-847d-804decef8e94 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:09.216346 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-59679111-bc74-4bd1-847d-804decef8e94 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:09.342846 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-59679111-bc74-4bd1-847d-804decef8e94 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:09.350931 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-59679111-bc74-4bd1-847d-804decef8e94 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 200 len: 1317 microversion: 2.1 time: 0.146567 May 19 15:09:09.351520 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 195/393] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:09 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:10.199954 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4622810b-7844-4d18-a79b-327f534c9021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:10.200720 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4622810b-7844-4d18-a79b-327f534c9021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:10.207469 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4622810b-7844-4d18-a79b-327f534c9021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:10.207925 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4622810b-7844-4d18-a79b-327f534c9021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:10.208684 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4622810b-7844-4d18-a79b-327f534c9021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:10.209117 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4622810b-7844-4d18-a79b-327f534c9021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:10.335909 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-adb08eac-e0f5-4937-8134-65e32164eca9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8e53055-9fa2-438b-82b9-e60595767ee8"}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:10.336983 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-adb08eac-e0f5-4937-8134-65e32164eca9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:10.338001 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4622810b-7844-4d18-a79b-327f534c9021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:10.343709 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-adb08eac-e0f5-4937-8134-65e32164eca9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:10.344441 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-adb08eac-e0f5-4937-8134-65e32164eca9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:10.345440 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-adb08eac-e0f5-4937-8134-65e32164eca9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:10.345886 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-adb08eac-e0f5-4937-8134-65e32164eca9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:10.346277 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4622810b-7844-4d18-a79b-327f534c9021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1680 microversion: 2.1 time: 0.150148 May 19 15:09:10.347090 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 199/394] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:10 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:10.369803 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d866ad29-64ad-42c0-8db5-8c4f937e1dc6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:10.370778 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d866ad29-64ad-42c0-8db5-8c4f937e1dc6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:10.378063 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d866ad29-64ad-42c0-8db5-8c4f937e1dc6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:10.378583 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d866ad29-64ad-42c0-8db5-8c4f937e1dc6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:10.379473 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d866ad29-64ad-42c0-8db5-8c4f937e1dc6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:10.380609 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d866ad29-64ad-42c0-8db5-8c4f937e1dc6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:10.574901 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d866ad29-64ad-42c0-8db5-8c4f937e1dc6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:10.582938 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d866ad29-64ad-42c0-8db5-8c4f937e1dc6 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 200 len: 1317 microversion: 2.1 time: 0.219253 May 19 15:09:10.587914 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 200/395] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:10 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:09:10.626111 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-adb08eac-e0f5-4937-8134-65e32164eca9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "POST /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294025 May 19 15:09:10.626763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 196/396] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 15:09:10 2022] POST /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:09:11.055042 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-e12850ba-444d-4311-91d1-22064de18d46 req-0beaeef0-b3c5-4804-b3cd-5b8a5158fde7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b9c3778-68d3-440a-b89c-22cf3a93baca", "name": "network-vif-deleted", "tag": "a54c0604-314a-4a3c-a1e0-e03eb78af1d6"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:11.068362 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-e12850ba-444d-4311-91d1-22064de18d46 req-0beaeef0-b3c5-4804-b3cd-5b8a5158fde7 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:11.078815 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-e12850ba-444d-4311-91d1-22064de18d46 req-0beaeef0-b3c5-4804-b3cd-5b8a5158fde7 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:11.107664 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-e12850ba-444d-4311-91d1-22064de18d46 req-0beaeef0-b3c5-4804-b3cd-5b8a5158fde7 service nova] Creating event network-vif-deleted:a54c0604-314a-4a3c-a1e0-e03eb78af1d6 for instance 2b9c3778-68d3-440a-b89c-22cf3a93baca on hv-cinder-82549 May 19 15:09:11.129244 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-e12850ba-444d-4311-91d1-22064de18d46 req-0beaeef0-b3c5-4804-b3cd-5b8a5158fde7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077083 May 19 15:09:11.129393 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 201/397] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:09:11.365464 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-5691a1a1-3689-4148-8c1a-7772755ec095 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:11.366779 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-5691a1a1-3689-4148-8c1a-7772755ec095 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:11.373247 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5691a1a1-3689-4148-8c1a-7772755ec095 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:11.373701 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5691a1a1-3689-4148-8c1a-7772755ec095 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:11.374456 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5691a1a1-3689-4148-8c1a-7772755ec095 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:11.374880 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5691a1a1-3689-4148-8c1a-7772755ec095 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:11.405778 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5691a1a1-3689-4148-8c1a-7772755ec095 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:11.406473 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5691a1a1-3689-4148-8c1a-7772755ec095 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:11.406924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-5691a1a1-3689-4148-8c1a-7772755ec095 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lazy-loading 'fault' on Instance uuid 2b9c3778-68d3-440a-b89c-22cf3a93baca {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:09:11.409766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:11.454902 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5691a1a1-3689-4148-8c1a-7772755ec095 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:11.464365 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-5691a1a1-3689-4148-8c1a-7772755ec095 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 200 len: 1330 microversion: 2.1 time: 0.104174 May 19 15:09:11.465691 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 197/398] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:11 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:11.601892 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-92e413d7-5d18-4f53-81ae-93880dfcc057 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:11.603352 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-92e413d7-5d18-4f53-81ae-93880dfcc057 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:11.610484 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-92e413d7-5d18-4f53-81ae-93880dfcc057 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:11.611184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-92e413d7-5d18-4f53-81ae-93880dfcc057 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:11.612148 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-92e413d7-5d18-4f53-81ae-93880dfcc057 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:11.612689 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-92e413d7-5d18-4f53-81ae-93880dfcc057 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:11.755062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-92e413d7-5d18-4f53-81ae-93880dfcc057 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:11.762488 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-92e413d7-5d18-4f53-81ae-93880dfcc057 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 200 len: 1317 microversion: 2.1 time: 0.166328 May 19 15:09:11.763167 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 202/399] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:11 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:12.156961 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-8c0194ac-86f7-42d1-a1aa-107189ee708b req-f8a9887b-6b59-4198-924a-ada948019704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4c1217-82c6-4ffa-bb29-2ab78d048fe4", "name": "network-vif-plugged", "status": "completed", "tag": "5f35a1f9-3029-4da3-9b81-244b3026f32a"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:12.166867 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-8c0194ac-86f7-42d1-a1aa-107189ee708b req-f8a9887b-6b59-4198-924a-ada948019704 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:12.167340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-8c0194ac-86f7-42d1-a1aa-107189ee708b req-f8a9887b-6b59-4198-924a-ada948019704 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:12.178424 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-8c0194ac-86f7-42d1-a1aa-107189ee708b req-f8a9887b-6b59-4198-924a-ada948019704 service nova] Creating event network-vif-plugged:5f35a1f9-3029-4da3-9b81-244b3026f32a for instance 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 on hv-cinder-82549 May 19 15:09:12.183232 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-8c0194ac-86f7-42d1-a1aa-107189ee708b req-f8a9887b-6b59-4198-924a-ada948019704 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030072 May 19 15:09:12.183982 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 198/400] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:09:12.485121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3d73cf9e-8e5d-4249-af2c-816befe62158 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:12.485765 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3d73cf9e-8e5d-4249-af2c-816befe62158 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:12.494830 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3d73cf9e-8e5d-4249-af2c-816befe62158 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:12.495780 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3d73cf9e-8e5d-4249-af2c-816befe62158 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:12.496869 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3d73cf9e-8e5d-4249-af2c-816befe62158 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:12.497660 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3d73cf9e-8e5d-4249-af2c-816befe62158 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:12.513415 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-3d73cf9e-8e5d-4249-af2c-816befe62158 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] HTTP exception thrown: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3d73cf9e-8e5d-4249-af2c-816befe62158 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Request method failure captured: May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca HTTP/1.1 May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihlzC36TVjbhLtU3g9xMp125AwUSov1duWZll1n5H-S_HScG7MruR7Gs1GViXAQd0SIJut8uotHNInm1_M2FBmXP1RayH0EJZ45YHoedSq6oTnynPABMFxjsri0-n9qTagsLk52YqxiHKDUiWNSXW6fHPq-ckGn5xy8R26VrSRWiq2XI May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:09:12.515116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:09:12.516657 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_34c1099557144b8bb2fff88f5b526834", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:09:12.516657 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:09:12.516657 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:09:12.516657 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:09:12.516657 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:09:12.516657 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:09:12.516657 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:09:12.516657 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: af7838e525a042dfa0357ad1fc58cf21 May 19 15:09:12.516657 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:09:12.516657 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:09:12.516657 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. May 19 15:09:12.516657 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': '2b9c3778-68d3-440a-b89c-22cf3a93baca'} May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:09:12.517485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. May 19 15:09:12.518990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:12.521344 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3d73cf9e-8e5d-4249-af2c-816befe62158 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Returning 404 to user: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:09:12.521344 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3d73cf9e-8e5d-4249-af2c-816befe62158 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 404 len: 111 microversion: 2.1 time: 0.035544 May 19 15:09:12.521344 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 203/401] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:12 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:09:12.526666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-571c216d-f37f-456f-bef5-088074567dbe tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '.version_select at 0x7f35d144dca0>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:12.544704 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-571c216d-f37f-456f-bef5-088074567dbe tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-330766060" status: 202 len: 0 microversion: 2.1 time: 0.022673 May 19 15:09:12.545270 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 199/402] 10.222.0.24 () {58 vars in 1217 bytes} [Thu May 19 15:09:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-330766060 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:09:12.780518 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-52e012d1-68da-4513-9f64-efbcaa1583c1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:12.782708 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-52e012d1-68da-4513-9f64-efbcaa1583c1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:12.791166 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-52e012d1-68da-4513-9f64-efbcaa1583c1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:12.791915 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-52e012d1-68da-4513-9f64-efbcaa1583c1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:12.793027 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-52e012d1-68da-4513-9f64-efbcaa1583c1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:12.793841 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-52e012d1-68da-4513-9f64-efbcaa1583c1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:12.885003 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-eb704d20-599d-4dff-a153-ba8aa499c43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:12.886078 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-eb704d20-599d-4dff-a153-ba8aa499c43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:12.893430 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-eb704d20-599d-4dff-a153-ba8aa499c43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:12.893888 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-eb704d20-599d-4dff-a153-ba8aa499c43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:12.894673 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-eb704d20-599d-4dff-a153-ba8aa499c43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:12.895150 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-eb704d20-599d-4dff-a153-ba8aa499c43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:12.925226 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-eb704d20-599d-4dff-a153-ba8aa499c43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lazy-loading 'flavor' on Instance uuid 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:09:13.065843 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-eb704d20-599d-4dff-a153-ba8aa499c43d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "POST /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/action" status: 200 len: 32 microversion: 2.1 time: 0.184758 May 19 15:09:13.067392 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 200/403] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 15:09:12 2022] POST /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 15:09:13.076318 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-93029933-56ad-417b-9ba6-cac558b558d2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:13.077287 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-93029933-56ad-417b-9ba6-cac558b558d2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:13.084455 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-93029933-56ad-417b-9ba6-cac558b558d2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:13.084904 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-93029933-56ad-417b-9ba6-cac558b558d2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:13.085678 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-93029933-56ad-417b-9ba6-cac558b558d2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:13.086115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-93029933-56ad-417b-9ba6-cac558b558d2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:13.356167 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-52e012d1-68da-4513-9f64-efbcaa1583c1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:13.365914 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-52e012d1-68da-4513-9f64-efbcaa1583c1 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 200 len: 1317 microversion: 2.1 time: 0.589617 May 19 15:09:13.366635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 204/404] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:12 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 1317 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:13.423189 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-93029933-56ad-417b-9ba6-cac558b558d2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:13.431565 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-93029933-56ad-417b-9ba6-cac558b558d2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.359309 May 19 15:09:13.432908 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 201/405] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:13 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:09:13.701308 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f51aa2a4-5d20-4976-bd96-0e47f013934b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:13.701813 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f51aa2a4-5d20-4976-bd96-0e47f013934b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:13.708472 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f51aa2a4-5d20-4976-bd96-0e47f013934b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:13.708932 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f51aa2a4-5d20-4976-bd96-0e47f013934b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:13.709698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f51aa2a4-5d20-4976-bd96-0e47f013934b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:13.710140 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f51aa2a4-5d20-4976-bd96-0e47f013934b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:13.792204 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-f51aa2a4-5d20-4976-bd96-0e47f013934b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lazy-loading 'services' on Instance uuid cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:09:13.862369 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f51aa2a4-5d20-4976-bd96-0e47f013934b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "DELETE /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3/os-volume_attachments/67697683-0e47-4b4b-b016-2bd493adc6b6" status: 202 len: 0 microversion: 2.1 time: 0.165194 May 19 15:09:13.863033 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 205/406] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 15:09:13 2022] DELETE /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3/os-volume_attachments/67697683-0e47-4b4b-b016-2bd493adc6b6 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 15:09:13.872146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-217ecf13-306a-4040-ab96-25c2bfc19aaf tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:13.873124 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-217ecf13-306a-4040-ab96-25c2bfc19aaf tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:13.879257 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-217ecf13-306a-4040-ab96-25c2bfc19aaf tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:13.880342 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-217ecf13-306a-4040-ab96-25c2bfc19aaf tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:13.881101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-217ecf13-306a-4040-ab96-25c2bfc19aaf tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:13.881534 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-217ecf13-306a-4040-ab96-25c2bfc19aaf tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:13.911263 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-217ecf13-306a-4040-ab96-25c2bfc19aaf tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043289 May 19 15:09:13.911804 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 202/407] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:09:13 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:09:14.383531 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c8effe73-e707-4251-8cdd-8b757a691b48 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:14.384232 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c8effe73-e707-4251-8cdd-8b757a691b48 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:14.390497 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c8effe73-e707-4251-8cdd-8b757a691b48 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:14.390947 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c8effe73-e707-4251-8cdd-8b757a691b48 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:14.391737 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c8effe73-e707-4251-8cdd-8b757a691b48 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:14.392169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c8effe73-e707-4251-8cdd-8b757a691b48 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:14.406232 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:14.448174 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a721bbc2-e4d3-4ac7-9461-ca2e1c1ddcd3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:14.448796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-a721bbc2-e4d3-4ac7-9461-ca2e1c1ddcd3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:14.455318 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a721bbc2-e4d3-4ac7-9461-ca2e1c1ddcd3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:14.455777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a721bbc2-e4d3-4ac7-9461-ca2e1c1ddcd3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:14.456553 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a721bbc2-e4d3-4ac7-9461-ca2e1c1ddcd3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:14.456996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a721bbc2-e4d3-4ac7-9461-ca2e1c1ddcd3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:14.564144 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c8effe73-e707-4251-8cdd-8b757a691b48 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:14.579386 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c8effe73-e707-4251-8cdd-8b757a691b48 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 200 len: 1506 microversion: 2.1 time: 0.200095 May 19 15:09:14.580154 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 206/408] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:14 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:14.595926 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b444803f-8230-443e-9de6-915d45bbeac8 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70ecb6fd-eee7-4929-ac8f-dda2c6f2a22b", "device": "/dev/sdb"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:14.597086 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b444803f-8230-443e-9de6-915d45bbeac8 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:14.599737 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:14.605966 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b444803f-8230-443e-9de6-915d45bbeac8 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:14.606680 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b444803f-8230-443e-9de6-915d45bbeac8 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:14.607327 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b444803f-8230-443e-9de6-915d45bbeac8 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:14.607774 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b444803f-8230-443e-9de6-915d45bbeac8 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:14.617925 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-a721bbc2-e4d3-4ac7-9461-ca2e1c1ddcd3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:14.625833 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:14.631273 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-a721bbc2-e4d3-4ac7-9461-ca2e1c1ddcd3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.185920 May 19 15:09:14.642430 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 203/409] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:14 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:09:14.881175 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b444803f-8230-443e-9de6-915d45bbeac8 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "POST /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288655 May 19 15:09:14.881808 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 207/410] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 15:09:14 2022] POST /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:09:14.922116 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-65eb32a6-0398-4591-9896-7aa0e44d6c13 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:14.923645 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-65eb32a6-0398-4591-9896-7aa0e44d6c13 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:14.926728 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=2 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:14.933937 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-65eb32a6-0398-4591-9896-7aa0e44d6c13 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:14.934583 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-65eb32a6-0398-4591-9896-7aa0e44d6c13 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:14.935631 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-65eb32a6-0398-4591-9896-7aa0e44d6c13 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:14.936234 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-65eb32a6-0398-4591-9896-7aa0e44d6c13 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:14.976101 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-65eb32a6-0398-4591-9896-7aa0e44d6c13 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057508 May 19 15:09:14.977147 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 204/411] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:09:14 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:09:15.648958 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f0499c3f-9a2a-4786-838c-47b8ea0bfb73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:15.649572 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f0499c3f-9a2a-4786-838c-47b8ea0bfb73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:15.655859 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f0499c3f-9a2a-4786-838c-47b8ea0bfb73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:15.656312 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f0499c3f-9a2a-4786-838c-47b8ea0bfb73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:15.657075 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f0499c3f-9a2a-4786-838c-47b8ea0bfb73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:15.657514 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f0499c3f-9a2a-4786-838c-47b8ea0bfb73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:15.791821 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f0499c3f-9a2a-4786-838c-47b8ea0bfb73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:15.799799 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f0499c3f-9a2a-4786-838c-47b8ea0bfb73 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.155736 May 19 15:09:15.800359 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 208/412] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:15 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:15.988065 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-05e6e2dc-e353-495a-8a5b-d949c44ed7f7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:15.989847 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-05e6e2dc-e353-495a-8a5b-d949c44ed7f7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:15.996502 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-05e6e2dc-e353-495a-8a5b-d949c44ed7f7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:15.996961 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-05e6e2dc-e353-495a-8a5b-d949c44ed7f7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:15.997848 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-05e6e2dc-e353-495a-8a5b-d949c44ed7f7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:15.998285 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-05e6e2dc-e353-495a-8a5b-d949c44ed7f7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:16.026022 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-05e6e2dc-e353-495a-8a5b-d949c44ed7f7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041858 May 19 15:09:16.026598 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 205/413] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:09:15 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 15:09:16.083656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-947e995d-ed5e-42ef-84d3-c7be593455fc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:16.084160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-947e995d-ed5e-42ef-84d3-c7be593455fc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:16.090492 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-947e995d-ed5e-42ef-84d3-c7be593455fc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:16.090954 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-947e995d-ed5e-42ef-84d3-c7be593455fc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:16.091759 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-947e995d-ed5e-42ef-84d3-c7be593455fc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:16.092202 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-947e995d-ed5e-42ef-84d3-c7be593455fc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:16.117012 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-947e995d-ed5e-42ef-84d3-c7be593455fc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:09:16.197046 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-947e995d-ed5e-42ef-84d3-c7be593455fc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "DELETE /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 204 len: 0 microversion: 2.1 time: 0.117400 May 19 15:09:16.197792 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 209/414] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:09:16 2022] DELETE /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:09:16.205702 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-cac02323-b479-4fc9-9f52-227d5916c31a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:16.206261 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-cac02323-b479-4fc9-9f52-227d5916c31a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:16.212915 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cac02323-b479-4fc9-9f52-227d5916c31a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:16.213362 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cac02323-b479-4fc9-9f52-227d5916c31a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:16.214123 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cac02323-b479-4fc9-9f52-227d5916c31a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:16.214574 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cac02323-b479-4fc9-9f52-227d5916c31a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:16.347303 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-cac02323-b479-4fc9-9f52-227d5916c31a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:16.355334 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-cac02323-b479-4fc9-9f52-227d5916c31a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1681 microversion: 2.1 time: 0.153507 May 19 15:09:16.355895 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 206/415] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:16 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:16.818467 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-40dbbddd-3775-4740-879d-e97985f12154 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:16.819161 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-40dbbddd-3775-4740-879d-e97985f12154 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:16.825624 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40dbbddd-3775-4740-879d-e97985f12154 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:16.826073 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40dbbddd-3775-4740-879d-e97985f12154 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:16.826846 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40dbbddd-3775-4740-879d-e97985f12154 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:16.827318 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40dbbddd-3775-4740-879d-e97985f12154 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:16.956910 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-40dbbddd-3775-4740-879d-e97985f12154 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:16.964766 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-40dbbddd-3775-4740-879d-e97985f12154 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.151014 May 19 15:09:16.965333 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 210/416] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:16 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:17.372634 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-5f785e74-371b-4f8a-a81b-2ecea2c97c61 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:17.373236 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-5f785e74-371b-4f8a-a81b-2ecea2c97c61 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:17.379761 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5f785e74-371b-4f8a-a81b-2ecea2c97c61 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:17.380210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5f785e74-371b-4f8a-a81b-2ecea2c97c61 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:17.380971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5f785e74-371b-4f8a-a81b-2ecea2c97c61 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:17.381401 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5f785e74-371b-4f8a-a81b-2ecea2c97c61 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:17.507911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5f785e74-371b-4f8a-a81b-2ecea2c97c61 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:17.515370 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-5f785e74-371b-4f8a-a81b-2ecea2c97c61 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1681 microversion: 2.1 time: 0.146776 May 19 15:09:17.515943 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 207/417] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:17 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:17.981709 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-19cd620e-3464-4bfc-9816-9e71539c5619 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:17.982320 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-19cd620e-3464-4bfc-9816-9e71539c5619 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:17.988760 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-19cd620e-3464-4bfc-9816-9e71539c5619 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:17.989893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-19cd620e-3464-4bfc-9816-9e71539c5619 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:17.990662 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-19cd620e-3464-4bfc-9816-9e71539c5619 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:17.991101 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-19cd620e-3464-4bfc-9816-9e71539c5619 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:18.121166 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-19cd620e-3464-4bfc-9816-9e71539c5619 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:18.129035 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-19cd620e-3464-4bfc-9816-9e71539c5619 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.151159 May 19 15:09:18.129597 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 211/418] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:17 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:18.533425 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-855795dc-233e-4acf-a575-a61283db6553 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:18.534011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-855795dc-233e-4acf-a575-a61283db6553 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:18.541832 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-855795dc-233e-4acf-a575-a61283db6553 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:18.542289 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-855795dc-233e-4acf-a575-a61283db6553 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:18.543064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-855795dc-233e-4acf-a575-a61283db6553 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:18.543698 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-855795dc-233e-4acf-a575-a61283db6553 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:18.675859 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-855795dc-233e-4acf-a575-a61283db6553 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:18.683766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-855795dc-233e-4acf-a575-a61283db6553 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1681 microversion: 2.1 time: 0.154347 May 19 15:09:18.685782 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 208/419] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:18 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:09:19.145955 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9e9240ab-5211-4c08-8089-37cbc7fbc5e4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:19.146663 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9e9240ab-5211-4c08-8089-37cbc7fbc5e4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:19.153395 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9e9240ab-5211-4c08-8089-37cbc7fbc5e4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:19.154064 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9e9240ab-5211-4c08-8089-37cbc7fbc5e4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:19.155041 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9e9240ab-5211-4c08-8089-37cbc7fbc5e4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:19.156032 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9e9240ab-5211-4c08-8089-37cbc7fbc5e4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:19.235950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-5ab87347-8444-469d-a265-5879220c949d req-ac7486af-ef91-4fce-b299-4f3f886a2007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3", "name": "network-vif-deleted", "tag": "99e00ce6-f671-4c78-ab3b-e03e6a5532ed"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:19.259053 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-5ab87347-8444-469d-a265-5879220c949d req-ac7486af-ef91-4fce-b299-4f3f886a2007 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:19.261384 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-5ab87347-8444-469d-a265-5879220c949d req-ac7486af-ef91-4fce-b299-4f3f886a2007 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:19.280363 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-5ab87347-8444-469d-a265-5879220c949d req-ac7486af-ef91-4fce-b299-4f3f886a2007 service nova] Creating event network-vif-deleted:99e00ce6-f671-4c78-ab3b-e03e6a5532ed for instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 on hv-cinder-82549 May 19 15:09:19.300806 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-5ab87347-8444-469d-a265-5879220c949d req-ac7486af-ef91-4fce-b299-4f3f886a2007 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069640 May 19 15:09:19.302273 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 209/420] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:09:19.349017 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9e9240ab-5211-4c08-8089-37cbc7fbc5e4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:19.359617 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9e9240ab-5211-4c08-8089-37cbc7fbc5e4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.217378 May 19 15:09:19.360220 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 212/421] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:19 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:19.701818 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-129faee1-be45-40e1-b933-79fb051e2583 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:19.702695 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-129faee1-be45-40e1-b933-79fb051e2583 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:19.709596 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-129faee1-be45-40e1-b933-79fb051e2583 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:19.709870 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-129faee1-be45-40e1-b933-79fb051e2583 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:19.710665 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-129faee1-be45-40e1-b933-79fb051e2583 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:19.711110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-129faee1-be45-40e1-b933-79fb051e2583 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:19.743861 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-129faee1-be45-40e1-b933-79fb051e2583 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:19.744529 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-129faee1-be45-40e1-b933-79fb051e2583 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:19.745023 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-129faee1-be45-40e1-b933-79fb051e2583 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lazy-loading 'fault' on Instance uuid cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:09:19.791876 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-129faee1-be45-40e1-b933-79fb051e2583 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:19.800621 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-129faee1-be45-40e1-b933-79fb051e2583 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 200 len: 1331 microversion: 2.1 time: 0.103622 May 19 15:09:19.802135 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 210/422] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:19 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:20.377409 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9215f689-c75e-4750-a57f-07343ef1ce6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:20.378087 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9215f689-c75e-4750-a57f-07343ef1ce6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:20.384849 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9215f689-c75e-4750-a57f-07343ef1ce6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:20.385303 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9215f689-c75e-4750-a57f-07343ef1ce6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:20.386095 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9215f689-c75e-4750-a57f-07343ef1ce6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:20.386533 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9215f689-c75e-4750-a57f-07343ef1ce6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:20.513715 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9215f689-c75e-4750-a57f-07343ef1ce6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:20.522235 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9215f689-c75e-4750-a57f-07343ef1ce6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.148723 May 19 15:09:20.522808 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 213/423] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:20 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:20.819168 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-78e29001-73b0-4afc-ac3c-8e6bd6c61f38 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:20.819755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-78e29001-73b0-4afc-ac3c-8e6bd6c61f38 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:20.826307 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-78e29001-73b0-4afc-ac3c-8e6bd6c61f38 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:20.826780 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-78e29001-73b0-4afc-ac3c-8e6bd6c61f38 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:20.827642 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-78e29001-73b0-4afc-ac3c-8e6bd6c61f38 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:20.828018 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-78e29001-73b0-4afc-ac3c-8e6bd6c61f38 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:20.842351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-78e29001-73b0-4afc-ac3c-8e6bd6c61f38 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] HTTP exception thrown: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-78e29001-73b0-4afc-ac3c-8e6bd6c61f38 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Request method failure captured: May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 HTTP/1.1 May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihlzC36TVjbhLtU3g9xMp125AwUSov1duWZll1n5H-S_HScG7MruR7Gs1GViXAQd0SIJut8uotHNInm1_M2FBmXP1RayH0EJZ45YHoedSq6oTnynPABMFxjsri0-n9qTagsLk52YqxiHKDUiWNSXW6fHPq-ckGn5xy8R26VrSRWiq2XI May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:09:20.844024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:09:20.845536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_34c1099557144b8bb2fff88f5b526834", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:09:20.845536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:09:20.845536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:09:20.845536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:09:20.845536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:09:20.845536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:09:20.845536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:09:20.845536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: af7838e525a042dfa0357ad1fc58cf21 May 19 15:09:20.845536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:09:20.845536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:09:20.845536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. May 19 15:09:20.845536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': 'cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3'} May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:09:20.846350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. May 19 15:09:20.847765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:09:20.848983 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-78e29001-73b0-4afc-ac3c-8e6bd6c61f38 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Returning 404 to user: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:09:20.848983 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-78e29001-73b0-4afc-ac3c-8e6bd6c61f38 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 404 len: 111 microversion: 2.1 time: 0.030797 May 19 15:09:20.848983 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 211/424] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:20 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:09:20.854154 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-62e32468-1836-45ba-bd2a-f3d12a4fc36e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '.version_select at 0x7f35d1390280>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:20.872708 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-62e32468-1836-45ba-bd2a-f3d12a4fc36e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1850093322" status: 202 len: 0 microversion: 2.1 time: 0.022275 May 19 15:09:20.873336 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 214/425] 10.222.0.24 () {58 vars in 1220 bytes} [Thu May 19 15:09:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1850093322 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:09:21.504585 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4a3922ab-1fb5-46b1-a1cd-db34638284f8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Action: 'create', calling method: .version_select at 0x7f35d1484430>, body: {"keypair": {"name": "tempest-keypair-337214131", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi51c30o7QtfL/aJyzD3JYeM3FD9yZw7TI9OMMxjg2b2jjwwSwv6+pnQowfQ5gvL5ePtUAgmZs5Po3CxBZrwIReyvLGS7wEDBtWuaZs6mao1HX2z0LFT5EIYDwFDnVy4Q=="}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:21.518324 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-4a3922ab-1fb5-46b1-a1cd-db34638284f8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for project 34c1099557144b8bb2fff88f5b526834. Resources: {'key_pairs'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:09:21.522619 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-4a3922ab-1fb5-46b1-a1cd-db34638284f8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for user af7838e525a042dfa0357ad1fc58cf21 and project 34c1099557144b8bb2fff88f5b526834. Resources: {'key_pairs'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:09:21.540598 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e3c48374-81f2-4828-b5af-f8ce135bbf6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:21.541298 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e3c48374-81f2-4828-b5af-f8ce135bbf6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:21.545075 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4a3922ab-1fb5-46b1-a1cd-db34638284f8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044384 May 19 15:09:21.545675 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 212/426] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 15:09:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:09:21.548256 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e3c48374-81f2-4828-b5af-f8ce135bbf6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:21.548723 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e3c48374-81f2-4828-b5af-f8ce135bbf6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:21.549536 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e3c48374-81f2-4828-b5af-f8ce135bbf6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:21.549987 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e3c48374-81f2-4828-b5af-f8ce135bbf6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:21.732301 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e3c48374-81f2-4828-b5af-f8ce135bbf6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:21.740295 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e3c48374-81f2-4828-b5af-f8ce135bbf6b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.205008 May 19 15:09:21.740867 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 215/427] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:21 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:09:22.758474 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-854be283-66de-4538-a0e3-77bdd98845a2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:22.759183 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-854be283-66de-4538-a0e3-77bdd98845a2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:22.765315 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-854be283-66de-4538-a0e3-77bdd98845a2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:22.766434 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-854be283-66de-4538-a0e3-77bdd98845a2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:22.767242 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-854be283-66de-4538-a0e3-77bdd98845a2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:22.767694 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-854be283-66de-4538-a0e3-77bdd98845a2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:22.898236 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-854be283-66de-4538-a0e3-77bdd98845a2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:22.906300 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-854be283-66de-4538-a0e3-77bdd98845a2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.152312 May 19 15:09:22.906866 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 213/428] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:22 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:22.932170 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-701030129", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c03712e-3615-4599-bcae-117320ca4aeb"}], "security_groups": [{"name": "tempest-securitygroup--1573474599"}], "key_name": "tempest-keypair-337214131", "user_data": "}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:23.038574 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] validate_networks() for [('6c03712e-3615-4599-bcae-117320ca4aeb', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:09:23.397535 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:09:23.397963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:09:23.398469 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:09:23.398879 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:09:23.399328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:09:23.408106 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:23.408559 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:23.409363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:23.409916 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:23.427317 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for project 34c1099557144b8bb2fff88f5b526834. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:09:23.431792 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for user af7838e525a042dfa0357ad1fc58cf21 and project 34c1099557144b8bb2fff88f5b526834. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:09:23.445933 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:09:23.448241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:09:23.494915 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-387733c2-30b2-4c98-b6d0-928d88ffbaa0 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.566967 May 19 15:09:23.495610 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 216/429] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:09:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:09:23.506344 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e22a2540-65c8-4de9-85ed-84abfdfd796e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:23.507044 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e22a2540-65c8-4de9-85ed-84abfdfd796e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:23.560281 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e22a2540-65c8-4de9-85ed-84abfdfd796e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:23.567559 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e22a2540-65c8-4de9-85ed-84abfdfd796e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1240 microversion: 2.1 time: 0.065331 May 19 15:09:23.568132 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 214/430] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:23 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:09:23.923970 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-88ca59fb-fc9b-4676-a782-8476dd1b49ba tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:23.924615 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-88ca59fb-fc9b-4676-a782-8476dd1b49ba tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:23.931347 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88ca59fb-fc9b-4676-a782-8476dd1b49ba tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:23.931808 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88ca59fb-fc9b-4676-a782-8476dd1b49ba tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:23.932576 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88ca59fb-fc9b-4676-a782-8476dd1b49ba tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:23.933138 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88ca59fb-fc9b-4676-a782-8476dd1b49ba tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:24.059000 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-88ca59fb-fc9b-4676-a782-8476dd1b49ba tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:24.066969 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-88ca59fb-fc9b-4676-a782-8476dd1b49ba tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.146922 May 19 15:09:24.067511 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 217/431] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:23 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:24.584371 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d727d2c4-9788-4e46-bff8-62620a9187ae tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:24.584992 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-d727d2c4-9788-4e46-bff8-62620a9187ae tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:24.591516 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d727d2c4-9788-4e46-bff8-62620a9187ae tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:24.591969 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d727d2c4-9788-4e46-bff8-62620a9187ae tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:24.592742 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d727d2c4-9788-4e46-bff8-62620a9187ae tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:24.593180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d727d2c4-9788-4e46-bff8-62620a9187ae tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:24.656749 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-d727d2c4-9788-4e46-bff8-62620a9187ae tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:24.665305 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-d727d2c4-9788-4e46-bff8-62620a9187ae tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1244 microversion: 2.1 time: 0.085177 May 19 15:09:24.665859 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 215/432] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:24 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:25.083516 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b1fd965f-4cc1-4656-ae64-9495c24c45ad tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:25.084170 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b1fd965f-4cc1-4656-ae64-9495c24c45ad tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:25.090516 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b1fd965f-4cc1-4656-ae64-9495c24c45ad tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:25.090967 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b1fd965f-4cc1-4656-ae64-9495c24c45ad tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:25.091763 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b1fd965f-4cc1-4656-ae64-9495c24c45ad tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:25.092201 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b1fd965f-4cc1-4656-ae64-9495c24c45ad tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:25.222092 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b1fd965f-4cc1-4656-ae64-9495c24c45ad tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:25.230603 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b1fd965f-4cc1-4656-ae64-9495c24c45ad tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.151589 May 19 15:09:25.231161 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 218/433] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:25 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:25.682645 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f9e7927b-66c3-455f-b49c-f7865db270bc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:25.683463 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f9e7927b-66c3-455f-b49c-f7865db270bc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:25.690030 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f9e7927b-66c3-455f-b49c-f7865db270bc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:25.690569 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f9e7927b-66c3-455f-b49c-f7865db270bc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:25.691387 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f9e7927b-66c3-455f-b49c-f7865db270bc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:25.692418 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f9e7927b-66c3-455f-b49c-f7865db270bc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:25.754094 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f9e7927b-66c3-455f-b49c-f7865db270bc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:25.756976 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:25.763249 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f9e7927b-66c3-455f-b49c-f7865db270bc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1292 microversion: 2.1 time: 0.085196 May 19 15:09:25.763823 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 216/434] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:25 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:26.247738 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f713d9de-c372-405f-95ed-ee60fab35b38 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:26.248337 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f713d9de-c372-405f-95ed-ee60fab35b38 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:26.251136 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:26.256638 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f713d9de-c372-405f-95ed-ee60fab35b38 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:26.257109 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f713d9de-c372-405f-95ed-ee60fab35b38 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:26.258024 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f713d9de-c372-405f-95ed-ee60fab35b38 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:26.258539 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f713d9de-c372-405f-95ed-ee60fab35b38 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:26.394004 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f713d9de-c372-405f-95ed-ee60fab35b38 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:26.402159 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f713d9de-c372-405f-95ed-ee60fab35b38 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.158625 May 19 15:09:26.402738 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 219/435] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:26 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:26.780650 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-2fdc8a87-a51f-4da6-befa-6aa038337ec7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:26.781277 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-2fdc8a87-a51f-4da6-befa-6aa038337ec7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:26.790898 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2fdc8a87-a51f-4da6-befa-6aa038337ec7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:26.799866 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2fdc8a87-a51f-4da6-befa-6aa038337ec7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:26.800942 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2fdc8a87-a51f-4da6-befa-6aa038337ec7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:26.801429 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2fdc8a87-a51f-4da6-befa-6aa038337ec7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:26.950209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-2fdc8a87-a51f-4da6-befa-6aa038337ec7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:26.958714 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-2fdc8a87-a51f-4da6-befa-6aa038337ec7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1366 microversion: 2.1 time: 0.181846 May 19 15:09:26.959319 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 217/436] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:26 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:27.419859 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-550ba1c0-fb55-42bd-a606-1503a20d31e9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:27.421014 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-550ba1c0-fb55-42bd-a606-1503a20d31e9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:27.428806 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-550ba1c0-fb55-42bd-a606-1503a20d31e9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:27.429267 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-550ba1c0-fb55-42bd-a606-1503a20d31e9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:27.430047 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-550ba1c0-fb55-42bd-a606-1503a20d31e9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:27.430482 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-550ba1c0-fb55-42bd-a606-1503a20d31e9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:27.564064 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-550ba1c0-fb55-42bd-a606-1503a20d31e9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:27.572659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-550ba1c0-fb55-42bd-a606-1503a20d31e9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.156761 May 19 15:09:27.573224 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 220/437] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:27 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:27.597366 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-0ccfabbf-be1f-43e8-adbd-061350dd7445 req-d04f4ddd-a46e-4f6f-a716-e7d507fd4939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f", "tag": "5baf0002-96ad-4905-b2cd-17f13f1918c2"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:27.606463 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-0ccfabbf-be1f-43e8-adbd-061350dd7445 req-d04f4ddd-a46e-4f6f-a716-e7d507fd4939 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:27.606919 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-0ccfabbf-be1f-43e8-adbd-061350dd7445 req-d04f4ddd-a46e-4f6f-a716-e7d507fd4939 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:27.630193 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-0ccfabbf-be1f-43e8-adbd-061350dd7445 req-d04f4ddd-a46e-4f6f-a716-e7d507fd4939 service nova] Creating event network-changed:5baf0002-96ad-4905-b2cd-17f13f1918c2 for instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f on hv-cinder-82549 May 19 15:09:27.636182 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-0ccfabbf-be1f-43e8-adbd-061350dd7445 req-d04f4ddd-a46e-4f6f-a716-e7d507fd4939 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042396 May 19 15:09:27.636869 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 218/438] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:09:27.976448 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2de9ed50-bbf6-44ec-b162-8866dc6d852d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:27.977063 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2de9ed50-bbf6-44ec-b162-8866dc6d852d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:27.983029 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2de9ed50-bbf6-44ec-b162-8866dc6d852d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:27.983518 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2de9ed50-bbf6-44ec-b162-8866dc6d852d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:27.984283 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2de9ed50-bbf6-44ec-b162-8866dc6d852d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:27.984721 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2de9ed50-bbf6-44ec-b162-8866dc6d852d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:28.112643 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2de9ed50-bbf6-44ec-b162-8866dc6d852d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:28.114820 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:28.121641 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2de9ed50-bbf6-44ec-b162-8866dc6d852d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1366 microversion: 2.1 time: 0.149659 May 19 15:09:28.122205 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 221/439] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:27 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:28.592283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f91b084a-24e7-45fc-91f4-5b67c7430640 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:28.592976 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f91b084a-24e7-45fc-91f4-5b67c7430640 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:28.599353 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f91b084a-24e7-45fc-91f4-5b67c7430640 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:28.599797 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f91b084a-24e7-45fc-91f4-5b67c7430640 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:28.600556 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f91b084a-24e7-45fc-91f4-5b67c7430640 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:28.600990 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f91b084a-24e7-45fc-91f4-5b67c7430640 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:28.730627 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f91b084a-24e7-45fc-91f4-5b67c7430640 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:28.738675 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f91b084a-24e7-45fc-91f4-5b67c7430640 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.152230 May 19 15:09:28.739261 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 219/440] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:28 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:29.138519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-292a9aa2-8886-4df8-aeec-71bb56f3165b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:29.139037 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-292a9aa2-8886-4df8-aeec-71bb56f3165b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:29.146868 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-292a9aa2-8886-4df8-aeec-71bb56f3165b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:29.147367 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-292a9aa2-8886-4df8-aeec-71bb56f3165b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:29.148138 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-292a9aa2-8886-4df8-aeec-71bb56f3165b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:29.148581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-292a9aa2-8886-4df8-aeec-71bb56f3165b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:29.277862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-292a9aa2-8886-4df8-aeec-71bb56f3165b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:29.285139 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-292a9aa2-8886-4df8-aeec-71bb56f3165b tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1366 microversion: 2.1 time: 0.150600 May 19 15:09:29.286216 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 222/441] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:29 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:29.755727 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c9ddf61e-22d8-4839-b5bc-eea8d1632160 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:29.756341 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c9ddf61e-22d8-4839-b5bc-eea8d1632160 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:29.763269 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c9ddf61e-22d8-4839-b5bc-eea8d1632160 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:29.763830 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c9ddf61e-22d8-4839-b5bc-eea8d1632160 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:29.764672 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c9ddf61e-22d8-4839-b5bc-eea8d1632160 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:29.765182 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c9ddf61e-22d8-4839-b5bc-eea8d1632160 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:29.917719 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c9ddf61e-22d8-4839-b5bc-eea8d1632160 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:29.927652 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c9ddf61e-22d8-4839-b5bc-eea8d1632160 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.175878 May 19 15:09:29.928430 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 220/442] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:29 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:30.305563 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-26d64254-1d4d-4ec4-9120-fcf993221f89 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:30.306182 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-26d64254-1d4d-4ec4-9120-fcf993221f89 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:30.313084 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-26d64254-1d4d-4ec4-9120-fcf993221f89 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:30.313540 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-26d64254-1d4d-4ec4-9120-fcf993221f89 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:30.314347 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-26d64254-1d4d-4ec4-9120-fcf993221f89 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:30.314819 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-26d64254-1d4d-4ec4-9120-fcf993221f89 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:30.448567 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-26d64254-1d4d-4ec4-9120-fcf993221f89 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:30.456246 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-26d64254-1d4d-4ec4-9120-fcf993221f89 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1366 microversion: 2.1 time: 0.155580 May 19 15:09:30.456812 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 223/443] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:30 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:30.943924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7ab5fa19-bf7d-4a30-b06b-99ccac6ad186 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:30.944539 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7ab5fa19-bf7d-4a30-b06b-99ccac6ad186 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:30.951059 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7ab5fa19-bf7d-4a30-b06b-99ccac6ad186 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:30.951545 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7ab5fa19-bf7d-4a30-b06b-99ccac6ad186 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:30.952306 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7ab5fa19-bf7d-4a30-b06b-99ccac6ad186 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:30.952742 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7ab5fa19-bf7d-4a30-b06b-99ccac6ad186 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:31.084637 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7ab5fa19-bf7d-4a30-b06b-99ccac6ad186 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:31.092897 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7ab5fa19-bf7d-4a30-b06b-99ccac6ad186 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.152749 May 19 15:09:31.093490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 221/444] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:30 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:31.473198 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5186de48-276c-49b5-9c75-7512063cec06 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:31.473840 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5186de48-276c-49b5-9c75-7512063cec06 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:31.480318 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5186de48-276c-49b5-9c75-7512063cec06 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:31.480766 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5186de48-276c-49b5-9c75-7512063cec06 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:31.481517 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5186de48-276c-49b5-9c75-7512063cec06 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:31.481952 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5186de48-276c-49b5-9c75-7512063cec06 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:31.607984 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5186de48-276c-49b5-9c75-7512063cec06 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:31.615245 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5186de48-276c-49b5-9c75-7512063cec06 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1366 microversion: 2.1 time: 0.145798 May 19 15:09:31.615807 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 224/445] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:31 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:32.111090 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ae7944c9-6009-4633-a049-d3de10046ca2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:32.111729 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ae7944c9-6009-4633-a049-d3de10046ca2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:32.119348 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ae7944c9-6009-4633-a049-d3de10046ca2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:32.119815 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ae7944c9-6009-4633-a049-d3de10046ca2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:32.120554 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ae7944c9-6009-4633-a049-d3de10046ca2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:32.120987 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ae7944c9-6009-4633-a049-d3de10046ca2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:32.254814 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ae7944c9-6009-4633-a049-d3de10046ca2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:32.262813 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ae7944c9-6009-4633-a049-d3de10046ca2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.155668 May 19 15:09:32.263409 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 222/446] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:32 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:32.631864 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-39ad94e6-746d-4ab0-a468-d5cfdb5c6f9c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:32.632487 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-39ad94e6-746d-4ab0-a468-d5cfdb5c6f9c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:32.640303 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-39ad94e6-746d-4ab0-a468-d5cfdb5c6f9c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:32.640991 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-39ad94e6-746d-4ab0-a468-d5cfdb5c6f9c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:32.641885 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-39ad94e6-746d-4ab0-a468-d5cfdb5c6f9c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:32.643002 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-39ad94e6-746d-4ab0-a468-d5cfdb5c6f9c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:32.785360 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-39ad94e6-746d-4ab0-a468-d5cfdb5c6f9c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:32.794292 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-39ad94e6-746d-4ab0-a468-d5cfdb5c6f9c tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1366 microversion: 2.1 time: 0.166284 May 19 15:09:32.795073 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 225/447] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:32 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:33.222253 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-8cf7df72-b93e-4591-b109-ff921c051bf3 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:33.222819 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-8cf7df72-b93e-4591-b109-ff921c051bf3 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:33.229542 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8cf7df72-b93e-4591-b109-ff921c051bf3 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:33.230008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8cf7df72-b93e-4591-b109-ff921c051bf3 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:33.230789 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8cf7df72-b93e-4591-b109-ff921c051bf3 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:33.231256 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8cf7df72-b93e-4591-b109-ff921c051bf3 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:33.280857 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d887880f-5aaa-4fc9-a07f-cedf83dcfe7a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:33.281916 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d887880f-5aaa-4fc9-a07f-cedf83dcfe7a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:33.288754 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d887880f-5aaa-4fc9-a07f-cedf83dcfe7a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:33.289580 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d887880f-5aaa-4fc9-a07f-cedf83dcfe7a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:33.290632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d887880f-5aaa-4fc9-a07f-cedf83dcfe7a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:33.291415 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d887880f-5aaa-4fc9-a07f-cedf83dcfe7a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:33.388289 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-8cf7df72-b93e-4591-b109-ff921c051bf3 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lazy-loading 'services' on Instance uuid 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:09:33.418585 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:33.440523 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:33.460682 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d887880f-5aaa-4fc9-a07f-cedf83dcfe7a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:33.468984 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d887880f-5aaa-4fc9-a07f-cedf83dcfe7a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1735 microversion: 2.1 time: 0.192664 May 19 15:09:33.469660 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 226/448] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:33 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:33.511273 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-8cf7df72-b93e-4591-b109-ff921c051bf3 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4/os-volume_attachments/70ecb6fd-eee7-4929-ac8f-dda2c6f2a22b" status: 202 len: 0 microversion: 2.1 time: 0.292761 May 19 15:09:33.511891 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 223/449] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 15:09:33 2022] DELETE /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4/os-volume_attachments/70ecb6fd-eee7-4929-ac8f-dda2c6f2a22b => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:09:33.810444 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-863810f5-4b5f-44f8-8ae3-3025eba7a2ed tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:33.811157 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-863810f5-4b5f-44f8-8ae3-3025eba7a2ed tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:33.817605 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-863810f5-4b5f-44f8-8ae3-3025eba7a2ed tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:33.818126 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-863810f5-4b5f-44f8-8ae3-3025eba7a2ed tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:33.818884 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-863810f5-4b5f-44f8-8ae3-3025eba7a2ed tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:33.819349 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-863810f5-4b5f-44f8-8ae3-3025eba7a2ed tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:33.945934 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-863810f5-4b5f-44f8-8ae3-3025eba7a2ed tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:33.953294 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-863810f5-4b5f-44f8-8ae3-3025eba7a2ed tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1366 microversion: 2.1 time: 0.146667 May 19 15:09:33.953855 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 227/450] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:33 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:34.483061 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=6 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:34.487760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-2dadc9e9-9893-49c6-a2e2-ab46ef4f419e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:34.488463 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-2dadc9e9-9893-49c6-a2e2-ab46ef4f419e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:34.490245 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:34.497403 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2dadc9e9-9893-49c6-a2e2-ab46ef4f419e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:34.497857 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2dadc9e9-9893-49c6-a2e2-ab46ef4f419e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:34.498653 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2dadc9e9-9893-49c6-a2e2-ab46ef4f419e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:34.499094 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2dadc9e9-9893-49c6-a2e2-ab46ef4f419e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:34.641904 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-2dadc9e9-9893-49c6-a2e2-ab46ef4f419e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:34.650525 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-2dadc9e9-9893-49c6-a2e2-ab46ef4f419e tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1715 microversion: 2.1 time: 0.168414 May 19 15:09:34.651093 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 224/451] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:34 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1715 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:34.752857 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b6117970-88da-4513-89cd-433f03c42881 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:34.753387 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b6117970-88da-4513-89cd-433f03c42881 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:34.759889 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b6117970-88da-4513-89cd-433f03c42881 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:34.760351 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b6117970-88da-4513-89cd-433f03c42881 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:34.761123 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b6117970-88da-4513-89cd-433f03c42881 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:34.761566 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b6117970-88da-4513-89cd-433f03c42881 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:34.815014 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-d60d81f9-dcac-48e5-853f-46af1b8a7b49 req-6f6cf376-2bac-4c4f-b0cd-90ed0722697a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f", "name": "network-vif-plugged", "status": "completed", "tag": "5baf0002-96ad-4905-b2cd-17f13f1918c2"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:34.824053 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-d60d81f9-dcac-48e5-853f-46af1b8a7b49 req-6f6cf376-2bac-4c4f-b0cd-90ed0722697a service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:34.824572 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-d60d81f9-dcac-48e5-853f-46af1b8a7b49 req-6f6cf376-2bac-4c4f-b0cd-90ed0722697a service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:34.835836 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-d60d81f9-dcac-48e5-853f-46af1b8a7b49 req-6f6cf376-2bac-4c4f-b0cd-90ed0722697a service nova] Creating event network-vif-plugged:5baf0002-96ad-4905-b2cd-17f13f1918c2 for instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f on hv-cinder-82549 May 19 15:09:34.840781 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-d60d81f9-dcac-48e5-853f-46af1b8a7b49 req-6f6cf376-2bac-4c4f-b0cd-90ed0722697a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029940 May 19 15:09:34.841557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 225/452] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:09:34.851369 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-b6117970-88da-4513-89cd-433f03c42881 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] HTTP exception thrown: Cannot 'detach_volume' instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 while it is in vm_state rescued May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b6117970-88da-4513-89cd-433f03c42881 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Request method failure captured: May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/os-volume_attachments/c8e53055-9fa2-438b-82b9-e60595767ee8 HTTP/1.1 May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihlzDaKprO0909qPKc4F_OazQwwc5_Rbafbmht_l8WXneyGFtInLfgtI9qenFfnQFlXMiKiG_mNerNQSxrT4phnzSvWe7hKeozkgWzbgSMTg6jjqWsZx06axD917IRiSdc6jQEGzZZbBsd1kyhzNheIUk6IECPe14kqEerVf8vh7H9Tk May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 199f08479d9541bc936bb4ea80bae96a May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-632949355 May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:09:34.852971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:09:34.854537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_199f08479d9541bc936bb4ea80bae96a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/199f08479d9541bc936bb4ea80bae96a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/199f08479d9541bc936bb4ea80bae96a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/199f08479d9541bc936bb4ea80bae96a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:09:34.854537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-ServerRescueNegativeTestJSON-632949355 May 19 15:09:34.854537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 199f08479d9541bc936bb4ea80bae96a May 19 15:09:34.854537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-632949355 May 19 15:09:34.854537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-ServerRescueNegativeTestJSON-632949355-project May 19 15:09:34.854537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:09:34.854537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:09:34.854537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: e5374c90f38b47fcb611e346f3f2ec69 May 19 15:09:34.854537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-ServerRescueNegativeTestJSON-632949355-project May 19 15:09:34.854537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:09:34.854537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Cannot 'detach_volume' instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 while it is in vm_state rescued May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'server_id': '9b30b6fd-1ba9-4939-baeb-d0fb305b1176', 'id': 'c8e53055-9fa2-438b-82b9-e60595767ee8'} May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:09:34.855451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 while it is in vm_state rescued May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 while it is in vm_state rescued May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:34.857519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b6117970-88da-4513-89cd-433f03c42881 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Returning 409 to user: Cannot 'detach_volume' instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 while it is in vm_state rescued {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:09:34.859413 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b6117970-88da-4513-89cd-433f03c42881 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/os-volume_attachments/c8e53055-9fa2-438b-82b9-e60595767ee8" status: 409 len: 152 microversion: 2.1 time: 0.105688 May 19 15:09:34.859413 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 228/453] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 15:09:34 2022] DELETE /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/os-volume_attachments/c8e53055-9fa2-438b-82b9-e60595767ee8 => generated 152 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 15:09:34.865352 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-670c9dd3-c318-4661-a211-e43b80e3fff4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:34.866126 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-670c9dd3-c318-4661-a211-e43b80e3fff4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:34.873021 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-670c9dd3-c318-4661-a211-e43b80e3fff4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:34.873581 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-670c9dd3-c318-4661-a211-e43b80e3fff4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:34.874428 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-670c9dd3-c318-4661-a211-e43b80e3fff4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:34.874942 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-670c9dd3-c318-4661-a211-e43b80e3fff4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:34.941985 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-670c9dd3-c318-4661-a211-e43b80e3fff4 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "POST /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/action" status: 202 len: 0 microversion: 2.1 time: 0.081896 May 19 15:09:34.943425 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 226/454] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 15:09:34 2022] POST /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:09:34.951355 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-bc30fda0-dc8d-4085-a80e-7033aca761c2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:34.951980 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bc30fda0-dc8d-4085-a80e-7033aca761c2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:34.958999 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bc30fda0-dc8d-4085-a80e-7033aca761c2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:34.959493 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bc30fda0-dc8d-4085-a80e-7033aca761c2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:34.960272 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bc30fda0-dc8d-4085-a80e-7033aca761c2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:34.960710 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bc30fda0-dc8d-4085-a80e-7033aca761c2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:34.971843 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e8d85247-8d40-43e6-9bfd-4fd701e4f2c3 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:34.972650 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e8d85247-8d40-43e6-9bfd-4fd701e4f2c3 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:34.979568 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e8d85247-8d40-43e6-9bfd-4fd701e4f2c3 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:34.980115 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e8d85247-8d40-43e6-9bfd-4fd701e4f2c3 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:34.981016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e8d85247-8d40-43e6-9bfd-4fd701e4f2c3 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:34.981568 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e8d85247-8d40-43e6-9bfd-4fd701e4f2c3 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:35.184537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-bc30fda0-dc8d-4085-a80e-7033aca761c2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:35.197495 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-bc30fda0-dc8d-4085-a80e-7033aca761c2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1723 microversion: 2.1 time: 0.249800 May 19 15:09:35.198493 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 229/455] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:34 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:35.204956 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e8d85247-8d40-43e6-9bfd-4fd701e4f2c3 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:35.215538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e8d85247-8d40-43e6-9bfd-4fd701e4f2c3 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1366 microversion: 2.1 time: 0.247794 May 19 15:09:35.216309 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 227/456] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:34 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:09:35.691633 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a37282a5-114e-4e07-bc56-c74256cce4ec tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:35.692166 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a37282a5-114e-4e07-bc56-c74256cce4ec tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:35.698104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a37282a5-114e-4e07-bc56-c74256cce4ec tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:35.698541 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a37282a5-114e-4e07-bc56-c74256cce4ec tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:35.699329 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a37282a5-114e-4e07-bc56-c74256cce4ec tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:35.699770 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a37282a5-114e-4e07-bc56-c74256cce4ec tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:35.724652 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a37282a5-114e-4e07-bc56-c74256cce4ec tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:09:35.803904 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a37282a5-114e-4e07-bc56-c74256cce4ec tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "DELETE /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 204 len: 0 microversion: 2.1 time: 0.115775 May 19 15:09:35.804764 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 230/457] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:09:35 2022] DELETE /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:09:35.814933 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-41b68e11-5053-49b1-8630-6a6972d24283 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:35.815587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-41b68e11-5053-49b1-8630-6a6972d24283 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:35.822029 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-41b68e11-5053-49b1-8630-6a6972d24283 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:35.822480 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-41b68e11-5053-49b1-8630-6a6972d24283 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:35.823351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-41b68e11-5053-49b1-8630-6a6972d24283 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:35.823840 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-41b68e11-5053-49b1-8630-6a6972d24283 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:35.953400 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-41b68e11-5053-49b1-8630-6a6972d24283 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:35.961408 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-41b68e11-5053-49b1-8630-6a6972d24283 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 200 len: 1512 microversion: 2.1 time: 0.152191 May 19 15:09:35.961972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 228/458] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:35 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:36.215674 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9450010d-ec48-42a0-bcb7-ee4ad96d7f03 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:36.216333 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9450010d-ec48-42a0-bcb7-ee4ad96d7f03 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:36.222726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9450010d-ec48-42a0-bcb7-ee4ad96d7f03 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:36.223182 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9450010d-ec48-42a0-bcb7-ee4ad96d7f03 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:36.223980 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9450010d-ec48-42a0-bcb7-ee4ad96d7f03 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:36.224419 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9450010d-ec48-42a0-bcb7-ee4ad96d7f03 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:36.232907 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6c4c050b-5407-4690-a75a-4bff221f2021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:36.233654 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-6c4c050b-5407-4690-a75a-4bff221f2021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:36.239698 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6c4c050b-5407-4690-a75a-4bff221f2021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:36.240152 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6c4c050b-5407-4690-a75a-4bff221f2021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:36.240914 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6c4c050b-5407-4690-a75a-4bff221f2021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:36.241348 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6c4c050b-5407-4690-a75a-4bff221f2021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:36.422065 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9450010d-ec48-42a0-bcb7-ee4ad96d7f03 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:36.426111 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6c4c050b-5407-4690-a75a-4bff221f2021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:36.430683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9450010d-ec48-42a0-bcb7-ee4ad96d7f03 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1723 microversion: 2.1 time: 0.219336 May 19 15:09:36.431278 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 231/459] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:36 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:36.433975 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6c4c050b-5407-4690-a75a-4bff221f2021 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1366 microversion: 2.1 time: 0.204859 May 19 15:09:36.434532 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 229/460] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:36 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:09:36.978410 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-879f416d-83cd-42b6-b637-73b2d3ca0bf2 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:36.979021 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-879f416d-83cd-42b6-b637-73b2d3ca0bf2 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:36.985010 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-879f416d-83cd-42b6-b637-73b2d3ca0bf2 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:36.985475 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-879f416d-83cd-42b6-b637-73b2d3ca0bf2 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:36.986238 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-879f416d-83cd-42b6-b637-73b2d3ca0bf2 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:36.986678 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-879f416d-83cd-42b6-b637-73b2d3ca0bf2 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:37.112046 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-879f416d-83cd-42b6-b637-73b2d3ca0bf2 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:37.120197 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-879f416d-83cd-42b6-b637-73b2d3ca0bf2 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 200 len: 1512 microversion: 2.1 time: 0.145688 May 19 15:09:37.120766 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 232/461] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:36 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:37.448517 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-84874308-ac62-4fa3-aa73-2f6bc4c5662a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:37.449131 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-84874308-ac62-4fa3-aa73-2f6bc4c5662a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:37.451154 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0c6be92b-1f5f-49ac-87a0-7018920c0d25 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:37.451879 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0c6be92b-1f5f-49ac-87a0-7018920c0d25 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:37.455680 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-84874308-ac62-4fa3-aa73-2f6bc4c5662a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:37.456138 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-84874308-ac62-4fa3-aa73-2f6bc4c5662a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:37.456910 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-84874308-ac62-4fa3-aa73-2f6bc4c5662a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:37.457355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-84874308-ac62-4fa3-aa73-2f6bc4c5662a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:37.459093 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0c6be92b-1f5f-49ac-87a0-7018920c0d25 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:37.459573 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0c6be92b-1f5f-49ac-87a0-7018920c0d25 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:37.460347 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0c6be92b-1f5f-49ac-87a0-7018920c0d25 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:37.460787 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0c6be92b-1f5f-49ac-87a0-7018920c0d25 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:37.651590 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-84874308-ac62-4fa3-aa73-2f6bc4c5662a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:37.654481 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0c6be92b-1f5f-49ac-87a0-7018920c0d25 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:37.659720 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-84874308-ac62-4fa3-aa73-2f6bc4c5662a tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1723 microversion: 2.1 time: 0.215078 May 19 15:09:37.660289 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 230/462] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:37 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:37.661879 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0c6be92b-1f5f-49ac-87a0-7018920c0d25 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1366 microversion: 2.1 time: 0.214704 May 19 15:09:37.662436 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 233/463] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:37 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:09:38.137026 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-39329157-da10-4ab7-bb46-4ed4c34e6211 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:38.137670 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-39329157-da10-4ab7-bb46-4ed4c34e6211 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:38.143684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-39329157-da10-4ab7-bb46-4ed4c34e6211 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:38.144137 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-39329157-da10-4ab7-bb46-4ed4c34e6211 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:38.144900 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-39329157-da10-4ab7-bb46-4ed4c34e6211 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:38.145429 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-39329157-da10-4ab7-bb46-4ed4c34e6211 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:38.270581 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-39329157-da10-4ab7-bb46-4ed4c34e6211 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:38.278676 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-39329157-da10-4ab7-bb46-4ed4c34e6211 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 200 len: 1512 microversion: 2.1 time: 0.145542 May 19 15:09:38.279267 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 231/464] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:38 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:38.676812 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8913f782-c387-4181-a31b-5dc702709ae2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:38.677433 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8913f782-c387-4181-a31b-5dc702709ae2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:38.677825 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-86450792-738e-47a3-9a07-0cbe4fe813fb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:38.678430 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-86450792-738e-47a3-9a07-0cbe4fe813fb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:38.684015 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8913f782-c387-4181-a31b-5dc702709ae2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:38.684475 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8913f782-c387-4181-a31b-5dc702709ae2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:38.684787 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-86450792-738e-47a3-9a07-0cbe4fe813fb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:38.685230 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-86450792-738e-47a3-9a07-0cbe4fe813fb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:38.685848 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8913f782-c387-4181-a31b-5dc702709ae2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:38.685982 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-86450792-738e-47a3-9a07-0cbe4fe813fb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:38.686319 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8913f782-c387-4181-a31b-5dc702709ae2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:38.686425 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-86450792-738e-47a3-9a07-0cbe4fe813fb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:38.877739 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8913f782-c387-4181-a31b-5dc702709ae2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:38.884592 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-86450792-738e-47a3-9a07-0cbe4fe813fb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:38.885700 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8913f782-c387-4181-a31b-5dc702709ae2 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1723 microversion: 2.1 time: 0.212757 May 19 15:09:38.886606 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 234/465] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:38 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:38.893895 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-86450792-738e-47a3-9a07-0cbe4fe813fb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1555 microversion: 2.1 time: 0.219274 May 19 15:09:38.894539 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 232/466] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:38 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1555 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:09:38.911528 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0aab49e9-5c09-40eb-bdba-7ae658ec0090 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:38.912027 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0aab49e9-5c09-40eb-bdba-7ae658ec0090 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:38.917946 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0aab49e9-5c09-40eb-bdba-7ae658ec0090 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:38.918399 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0aab49e9-5c09-40eb-bdba-7ae658ec0090 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:38.919160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0aab49e9-5c09-40eb-bdba-7ae658ec0090 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:38.919628 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0aab49e9-5c09-40eb-bdba-7ae658ec0090 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:38.997166 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0aab49e9-5c09-40eb-bdba-7ae658ec0090 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090111 May 19 15:09:38.997788 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 235/467] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 15:09:38 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:09:39.296364 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b1efb78d-7b9f-421c-84e8-ee9e0aa1a6cb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:39.296890 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b1efb78d-7b9f-421c-84e8-ee9e0aa1a6cb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:39.303799 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b1efb78d-7b9f-421c-84e8-ee9e0aa1a6cb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:39.304254 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b1efb78d-7b9f-421c-84e8-ee9e0aa1a6cb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:39.305034 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b1efb78d-7b9f-421c-84e8-ee9e0aa1a6cb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:39.305477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b1efb78d-7b9f-421c-84e8-ee9e0aa1a6cb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:39.308570 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:39.630851 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-b1efb78d-7b9f-421c-84e8-ee9e0aa1a6cb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:39.638417 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-b1efb78d-7b9f-421c-84e8-ee9e0aa1a6cb tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 200 len: 1512 microversion: 2.1 time: 0.346126 May 19 15:09:39.638988 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 233/468] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:39 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 1512 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:39.904095 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-29a44882-0733-4779-bb48-8f746f3182b1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:39.904714 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-29a44882-0733-4779-bb48-8f746f3182b1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:39.910645 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-29a44882-0733-4779-bb48-8f746f3182b1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:39.911675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-29a44882-0733-4779-bb48-8f746f3182b1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:39.912447 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-29a44882-0733-4779-bb48-8f746f3182b1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:39.912886 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-29a44882-0733-4779-bb48-8f746f3182b1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:40.135182 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-29a44882-0733-4779-bb48-8f746f3182b1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:40.143126 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-29a44882-0733-4779-bb48-8f746f3182b1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1723 microversion: 2.1 time: 0.243523 May 19 15:09:40.143986 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 236/469] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:39 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:40.282883 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-37fce3f1-ef2d-4594-884b-f310f3571d2c req-d289494c-d59a-44ea-a106-6383e730f6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f", "tag": "5baf0002-96ad-4905-b2cd-17f13f1918c2"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:40.292490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-37fce3f1-ef2d-4594-884b-f310f3571d2c req-d289494c-d59a-44ea-a106-6383e730f6e1 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:40.292930 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-37fce3f1-ef2d-4594-884b-f310f3571d2c req-d289494c-d59a-44ea-a106-6383e730f6e1 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:40.304491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-37fce3f1-ef2d-4594-884b-f310f3571d2c req-d289494c-d59a-44ea-a106-6383e730f6e1 service nova] Creating event network-changed:5baf0002-96ad-4905-b2cd-17f13f1918c2 for instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f on hv-cinder-82549 May 19 15:09:40.309564 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-37fce3f1-ef2d-4594-884b-f310f3571d2c req-d289494c-d59a-44ea-a106-6383e730f6e1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030324 May 19 15:09:40.310559 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 234/470] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:09:40.655566 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-418cb9d2-0475-4385-a90e-825ad8d06363 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:40.656260 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-418cb9d2-0475-4385-a90e-825ad8d06363 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:40.662458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-418cb9d2-0475-4385-a90e-825ad8d06363 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:40.662917 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-418cb9d2-0475-4385-a90e-825ad8d06363 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:40.663730 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-418cb9d2-0475-4385-a90e-825ad8d06363 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:40.664175 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-418cb9d2-0475-4385-a90e-825ad8d06363 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:40.668215 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:40.804347 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-418cb9d2-0475-4385-a90e-825ad8d06363 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:40.812364 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-418cb9d2-0475-4385-a90e-825ad8d06363 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 200 len: 1512 microversion: 2.1 time: 0.160637 May 19 15:09:40.813154 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 237/471] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:40 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:41.161340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d292bbac-65ec-4a4a-9c00-321e8244a8d1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:41.162043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-d292bbac-65ec-4a4a-9c00-321e8244a8d1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:41.168907 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d292bbac-65ec-4a4a-9c00-321e8244a8d1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:41.169368 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d292bbac-65ec-4a4a-9c00-321e8244a8d1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:41.170132 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d292bbac-65ec-4a4a-9c00-321e8244a8d1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:41.170566 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d292bbac-65ec-4a4a-9c00-321e8244a8d1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:41.172440 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-bb39010b-722f-41c8-9c3c-a0fec7f8b6aa req-bd986807-3b34-4d56-8115-e106b735cc0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4c1217-82c6-4ffa-bb29-2ab78d048fe4", "name": "network-vif-deleted", "tag": "5f35a1f9-3029-4da3-9b81-244b3026f32a"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:41.182620 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-bb39010b-722f-41c8-9c3c-a0fec7f8b6aa req-bd986807-3b34-4d56-8115-e106b735cc0b service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:41.183506 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-bb39010b-722f-41c8-9c3c-a0fec7f8b6aa req-bd986807-3b34-4d56-8115-e106b735cc0b service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:41.198808 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-bb39010b-722f-41c8-9c3c-a0fec7f8b6aa req-bd986807-3b34-4d56-8115-e106b735cc0b service nova] Creating event network-vif-deleted:5f35a1f9-3029-4da3-9b81-244b3026f32a for instance 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 on hv-cinder-82549 May 19 15:09:41.204886 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-bb39010b-722f-41c8-9c3c-a0fec7f8b6aa req-bd986807-3b34-4d56-8115-e106b735cc0b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037290 May 19 15:09:41.205620 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 238/472] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:09:41.319519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-d292bbac-65ec-4a4a-9c00-321e8244a8d1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:41.328870 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-d292bbac-65ec-4a4a-9c00-321e8244a8d1 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1729 microversion: 2.1 time: 0.171805 May 19 15:09:41.329635 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 235/473] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:41 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:41.345903 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-14ac4c85-d75b-44c3-a188-050f5e15602d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:41.346511 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-14ac4c85-d75b-44c3-a188-050f5e15602d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:41.353251 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-14ac4c85-d75b-44c3-a188-050f5e15602d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:41.353697 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-14ac4c85-d75b-44c3-a188-050f5e15602d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:41.354453 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-14ac4c85-d75b-44c3-a188-050f5e15602d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:41.355058 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-14ac4c85-d75b-44c3-a188-050f5e15602d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:41.446256 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-14ac4c85-d75b-44c3-a188-050f5e15602d tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104940 May 19 15:09:41.451897 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 239/474] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 15:09:41 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:09:41.829508 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-da1604ef-2bbe-4f2c-8467-b6ec386ca40b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:41.830149 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-da1604ef-2bbe-4f2c-8467-b6ec386ca40b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:41.836708 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-da1604ef-2bbe-4f2c-8467-b6ec386ca40b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:41.837154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-da1604ef-2bbe-4f2c-8467-b6ec386ca40b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:41.837968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-da1604ef-2bbe-4f2c-8467-b6ec386ca40b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:41.838404 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-da1604ef-2bbe-4f2c-8467-b6ec386ca40b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:41.871615 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-da1604ef-2bbe-4f2c-8467-b6ec386ca40b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:41.872294 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-da1604ef-2bbe-4f2c-8467-b6ec386ca40b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:41.872899 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-da1604ef-2bbe-4f2c-8467-b6ec386ca40b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lazy-loading 'fault' on Instance uuid 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:09:41.929138 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-da1604ef-2bbe-4f2c-8467-b6ec386ca40b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d796b832c442c0a2af8ef603879f30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f7a1fc211304ed3a001282402fa73cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:41.939495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-da1604ef-2bbe-4f2c-8467-b6ec386ca40b tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 200 len: 1307 microversion: 2.1 time: 0.113692 May 19 15:09:41.940631 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 236/475] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:41 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:42.386405 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-3b25d718-4a4d-45b2-a597-01b5eda5a35d req-ca797e72-33a2-4891-ae00-3cae7732dd48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b30b6fd-1ba9-4939-baeb-d0fb305b1176", "tag": "7377972f-e26c-43d1-ac62-ddf4b52e4bfd"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:42.394998 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-3b25d718-4a4d-45b2-a597-01b5eda5a35d req-ca797e72-33a2-4891-ae00-3cae7732dd48 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:42.395173 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-3b25d718-4a4d-45b2-a597-01b5eda5a35d req-ca797e72-33a2-4891-ae00-3cae7732dd48 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:42.408618 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-3b25d718-4a4d-45b2-a597-01b5eda5a35d req-ca797e72-33a2-4891-ae00-3cae7732dd48 service nova] Creating event network-changed:7377972f-e26c-43d1-ac62-ddf4b52e4bfd for instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 on hv-cinder-82549 May 19 15:09:42.411520 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-3b25d718-4a4d-45b2-a597-01b5eda5a35d req-ca797e72-33a2-4891-ae00-3cae7732dd48 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029288 May 19 15:09:42.412113 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 240/476] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:09:42.957717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-975968d2-e05f-4fa3-8f83-b7c1d7b04247 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:42.958342 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-975968d2-e05f-4fa3-8f83-b7c1d7b04247 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] [instance: 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:42.964871 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-975968d2-e05f-4fa3-8f83-b7c1d7b04247 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:42.965319 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-975968d2-e05f-4fa3-8f83-b7c1d7b04247 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:42.966071 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-975968d2-e05f-4fa3-8f83-b7c1d7b04247 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:42.966502 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-975968d2-e05f-4fa3-8f83-b7c1d7b04247 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:42.980271 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-975968d2-e05f-4fa3-8f83-b7c1d7b04247 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] HTTP exception thrown: Instance 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 could not be found. May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-975968d2-e05f-4fa3-8f83-b7c1d7b04247 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Request method failure captured: May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 HTTP/1.1 May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihl03bRgvXTc4FRSVw0vnlNrtcLWbMzfXGnQTNSrnwamE1jLMwlDHLLQDaZdx2gEapr4ik-2ungWyaaaJ0mg9TTmSRV1cSIJ6pVup4H9-t-hfDZnepu8cyVs525ITgwZnRF-1EScL-4-OmACSF81AT0LB3yLK-ouZ-c0V2sogAx2AtJY May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 8f7a1fc211304ed3a001282402fa73cc May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2145419031 May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:09:42.981911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:09:42.983531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_8f7a1fc211304ed3a001282402fa73cc", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8f7a1fc211304ed3a001282402fa73cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/8f7a1fc211304ed3a001282402fa73cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/8f7a1fc211304ed3a001282402fa73cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:09:42.983531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-VolumesSnapshotTestJSON-2145419031 May 19 15:09:42.983531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 8f7a1fc211304ed3a001282402fa73cc May 19 15:09:42.983531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2145419031 May 19 15:09:42.983531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-VolumesSnapshotTestJSON-2145419031-project May 19 15:09:42.983531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:09:42.983531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:09:42.983531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: f7d796b832c442c0a2af8ef603879f30 May 19 15:09:42.983531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-VolumesSnapshotTestJSON-2145419031-project May 19 15:09:42.983531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:09:42.983531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 could not be found. May 19 15:09:42.983531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '8c4c1217-82c6-4ffa-bb29-2ab78d048fe4'} May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 could not be found. May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:09:42.984610 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 could not be found. May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 could not be found. May 19 15:09:42.986406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:09:42.988207 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-975968d2-e05f-4fa3-8f83-b7c1d7b04247 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] Returning 404 to user: Instance 8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:09:42.988207 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-975968d2-e05f-4fa3-8f83-b7c1d7b04247 tempest-VolumesSnapshotTestJSON-2145419031 tempest-VolumesSnapshotTestJSON-2145419031-project] 10.222.0.24 "GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4" status: 404 len: 111 microversion: 2.1 time: 0.029438 May 19 15:09:42.988207 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 237/477] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:09:42 2022] GET /compute/v2.1/servers/8c4c1217-82c6-4ffa-bb29-2ab78d048fe4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:09:44.430905 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-0010c25e-c8fc-4924-b464-6e78db50fba7 req-00e03fcb-990b-4c7f-a87e-791c089f7b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b30b6fd-1ba9-4939-baeb-d0fb305b1176", "tag": "7377972f-e26c-43d1-ac62-ddf4b52e4bfd"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:44.440568 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-0010c25e-c8fc-4924-b464-6e78db50fba7 req-00e03fcb-990b-4c7f-a87e-791c089f7b33 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:44.449822 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-0010c25e-c8fc-4924-b464-6e78db50fba7 req-00e03fcb-990b-4c7f-a87e-791c089f7b33 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:44.464251 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-0010c25e-c8fc-4924-b464-6e78db50fba7 req-00e03fcb-990b-4c7f-a87e-791c089f7b33 service nova] Creating event network-changed:7377972f-e26c-43d1-ac62-ddf4b52e4bfd for instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 on hv-cinder-82549 May 19 15:09:44.469894 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-0010c25e-c8fc-4924-b464-6e78db50fba7 req-00e03fcb-990b-4c7f-a87e-791c089f7b33 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044965 May 19 15:09:44.471397 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 241/478] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:09:54.564270 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b395a713-ba4a-4035-b326-f444a52b6514 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:54.564805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b395a713-ba4a-4035-b326-f444a52b6514 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:54.567583 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=29 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:54.568185 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=23 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:54.574007 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b395a713-ba4a-4035-b326-f444a52b6514 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:54.574460 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b395a713-ba4a-4035-b326-f444a52b6514 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:54.575243 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b395a713-ba4a-4035-b326-f444a52b6514 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:54.575688 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b395a713-ba4a-4035-b326-f444a52b6514 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:54.604752 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-b395a713-ba4a-4035-b326-f444a52b6514 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/os-volume_attachments/0b3fb604-3097-480f-82b0-382f47aed7ce" status: 200 len: 194 microversion: 2.20 time: 0.044486 May 19 15:09:54.605540 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 238/479] 10.222.0.24 () {60 vars in 1453 bytes} [Thu May 19 15:09:54 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/os-volume_attachments/0b3fb604-3097-480f-82b0-382f47aed7ce => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 15:09:54.665880 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:54.666697 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=15 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:09:54.671642 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-787422f0-3ab5-4029-81c0-2c8dd48d2296 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:54.672234 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-787422f0-3ab5-4029-81c0-2c8dd48d2296 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:54.680522 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-787422f0-3ab5-4029-81c0-2c8dd48d2296 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:54.681075 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-787422f0-3ab5-4029-81c0-2c8dd48d2296 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:54.681849 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-787422f0-3ab5-4029-81c0-2c8dd48d2296 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:54.682290 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-787422f0-3ab5-4029-81c0-2c8dd48d2296 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:54.764627 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-787422f0-3ab5-4029-81c0-2c8dd48d2296 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lazy-loading 'services' on Instance uuid 6324753a-5912-42c2-a1f4-0bc631bea605 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:09:54.836360 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-787422f0-3ab5-4029-81c0-2c8dd48d2296 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "DELETE /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/os-volume_attachments/0b3fb604-3097-480f-82b0-382f47aed7ce" status: 202 len: 0 microversion: 2.20 time: 0.172010 May 19 15:09:54.836961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 242/480] 10.222.0.24 () {60 vars in 1456 bytes} [Thu May 19 15:09:54 2022] DELETE /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/os-volume_attachments/0b3fb604-3097-480f-82b0-382f47aed7ce => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 15:09:54.845302 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-8ea7d34b-e42a-4940-af89-5d3acf49d8a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:54.846271 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-8ea7d34b-e42a-4940-af89-5d3acf49d8a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:54.852640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8ea7d34b-e42a-4940-af89-5d3acf49d8a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:54.853148 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8ea7d34b-e42a-4940-af89-5d3acf49d8a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:54.853923 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8ea7d34b-e42a-4940-af89-5d3acf49d8a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:54.854358 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8ea7d34b-e42a-4940-af89-5d3acf49d8a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:54.884911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-8ea7d34b-e42a-4940-af89-5d3acf49d8a3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043519 May 19 15:09:54.885738 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 239/481] 10.222.0.24 () {60 vars in 1342 bytes} [Thu May 19 15:09:54 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 15:09:55.898194 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f44fed2a-b72d-4bbc-a35c-96e270d25941 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:55.899217 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f44fed2a-b72d-4bbc-a35c-96e270d25941 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:55.906058 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f44fed2a-b72d-4bbc-a35c-96e270d25941 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:55.906560 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f44fed2a-b72d-4bbc-a35c-96e270d25941 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:55.907362 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f44fed2a-b72d-4bbc-a35c-96e270d25941 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:55.907822 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f44fed2a-b72d-4bbc-a35c-96e270d25941 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:55.937727 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f44fed2a-b72d-4bbc-a35c-96e270d25941 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044878 May 19 15:09:55.938297 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 243/482] 10.222.0.24 () {60 vars in 1342 bytes} [Thu May 19 15:09:55 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:09:55.998824 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-79bd4823-4c72-42dc-a88d-03e96a49b6ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:55.999387 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-79bd4823-4c72-42dc-a88d-03e96a49b6ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:56.005959 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-79bd4823-4c72-42dc-a88d-03e96a49b6ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:56.006451 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-79bd4823-4c72-42dc-a88d-03e96a49b6ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:56.007346 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-79bd4823-4c72-42dc-a88d-03e96a49b6ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:56.007829 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-79bd4823-4c72-42dc-a88d-03e96a49b6ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:56.034770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-79bd4823-4c72-42dc-a88d-03e96a49b6ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Going to try to terminate instance {{(pid=117445) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:09:56.110438 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-79bd4823-4c72-42dc-a88d-03e96a49b6ff tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "DELETE /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 204 len: 0 microversion: 2.20 time: 0.114936 May 19 15:09:56.111323 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 240/483] 10.222.0.24 () {60 vars in 1279 bytes} [Thu May 19 15:09:55 2022] DELETE /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 15:09:56.119827 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-263612e4-170d-4043-abac-4befd3bf9542 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:56.120483 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-263612e4-170d-4043-abac-4befd3bf9542 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:56.126296 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-263612e4-170d-4043-abac-4befd3bf9542 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:56.126741 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-263612e4-170d-4043-abac-4befd3bf9542 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:56.127518 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-263612e4-170d-4043-abac-4befd3bf9542 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:56.127952 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-263612e4-170d-4043-abac-4befd3bf9542 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:56.258531 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-263612e4-170d-4043-abac-4befd3bf9542 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:56.266348 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-263612e4-170d-4043-abac-4befd3bf9542 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:56.267989 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-263612e4-170d-4043-abac-4befd3bf9542 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:56.269147 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-263612e4-170d-4043-abac-4befd3bf9542 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.153468 May 19 15:09:56.269708 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 244/484] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:09:56 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:09:57.289422 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-728632fd-d10b-440e-bced-12c70e4434d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:57.290060 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-728632fd-d10b-440e-bced-12c70e4434d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:57.296511 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-728632fd-d10b-440e-bced-12c70e4434d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:57.296910 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-728632fd-d10b-440e-bced-12c70e4434d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:57.297743 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-728632fd-d10b-440e-bced-12c70e4434d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:57.298184 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-728632fd-d10b-440e-bced-12c70e4434d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:57.430418 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-728632fd-d10b-440e-bced-12c70e4434d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:57.438478 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-728632fd-d10b-440e-bced-12c70e4434d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:57.440021 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-728632fd-d10b-440e-bced-12c70e4434d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:57.441197 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-728632fd-d10b-440e-bced-12c70e4434d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1723 microversion: 2.20 time: 0.157006 May 19 15:09:57.441754 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 241/485] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:09:57 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:09:58.458767 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-46a56131-b709-4d5f-a27c-7f86e753b916 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:58.459367 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-46a56131-b709-4d5f-a27c-7f86e753b916 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:58.466275 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-46a56131-b709-4d5f-a27c-7f86e753b916 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:58.466792 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-46a56131-b709-4d5f-a27c-7f86e753b916 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:58.467607 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-46a56131-b709-4d5f-a27c-7f86e753b916 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:58.468054 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-46a56131-b709-4d5f-a27c-7f86e753b916 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:58.530576 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-46a56131-b709-4d5f-a27c-7f86e753b916 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:58.538595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-46a56131-b709-4d5f-a27c-7f86e753b916 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:58.540155 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-46a56131-b709-4d5f-a27c-7f86e753b916 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:09:58.541316 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-46a56131-b709-4d5f-a27c-7f86e753b916 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 200 len: 1656 microversion: 2.20 time: 0.086715 May 19 15:09:58.541912 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 245/486] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:09:58 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 1656 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:09:58.638895 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-3e0356a3-66e5-4536-925c-548e4efcf415 req-34bab13c-0177-42ce-acf5-fd416e29ffad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6324753a-5912-42c2-a1f4-0bc631bea605", "name": "network-vif-deleted", "tag": "3beaa750-59c9-4ce6-b188-390d70f3fb7a"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:09:58.648490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-3e0356a3-66e5-4536-925c-548e4efcf415 req-34bab13c-0177-42ce-acf5-fd416e29ffad service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:58.648931 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-3e0356a3-66e5-4536-925c-548e4efcf415 req-34bab13c-0177-42ce-acf5-fd416e29ffad service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:58.660108 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-3e0356a3-66e5-4536-925c-548e4efcf415 req-34bab13c-0177-42ce-acf5-fd416e29ffad service nova] Creating event network-vif-deleted:3beaa750-59c9-4ce6-b188-390d70f3fb7a for instance 6324753a-5912-42c2-a1f4-0bc631bea605 on hv-cinder-82549 May 19 15:09:58.665480 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-3e0356a3-66e5-4536-925c-548e4efcf415 req-34bab13c-0177-42ce-acf5-fd416e29ffad service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030183 May 19 15:09:58.666347 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 242/487] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:09:59.559815 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-392d578d-53aa-4ab7-8e32-a60ffdad6d52 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:59.560378 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-392d578d-53aa-4ab7-8e32-a60ffdad6d52 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:09:59.567806 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-392d578d-53aa-4ab7-8e32-a60ffdad6d52 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:59.568265 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-392d578d-53aa-4ab7-8e32-a60ffdad6d52 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:59.569050 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-392d578d-53aa-4ab7-8e32-a60ffdad6d52 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:09:59.569492 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-392d578d-53aa-4ab7-8e32-a60ffdad6d52 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:09:59.584215 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-392d578d-53aa-4ab7-8e32-a60ffdad6d52 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] HTTP exception thrown: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-392d578d-53aa-4ab7-8e32-a60ffdad6d52 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Request method failure captured: May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 HTTP/1.1 May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihlzM__jTohOtZrndaWvceCISqKFJD4aau4T53O7gL18XPKHZIZx-YcdR6hUQDJx_jCOmPmLd9T1JACzcwiydfkU6ISOVeKNS2GNJ1zXviSHARqrgF1SukhsSP2k-bWVV09rFNoru5e66LpVddV3ziUMvsXHXRoKRby4YMloSqoP5VQM May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Openstack-Nova-Api-Version: 2.20 May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: edea803526e44a55b74472ecefdb0fbc May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:09:59.586363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:09:59.587781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_edea803526e44a55b74472ecefdb0fbc", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:09:59.587781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:09:59.587781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: edea803526e44a55b74472ecefdb0fbc May 19 15:09:59.587781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:09:59.587781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeShelveTestJSON-489527708-project May 19 15:09:59.587781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:09:59.587781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:09:59.587781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: 644abe5583e94049abd23e4ca050a066 May 19 15:09:59.587781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeShelveTestJSON-489527708-project May 19 15:09:59.587781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:09:59.587781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. May 19 15:09:59.587781 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': '6324753a-5912-42c2-a1f4-0bc631bea605'} May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:09:59.588581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. May 19 15:09:59.589791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:09:59.590851 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-392d578d-53aa-4ab7-8e32-a60ffdad6d52 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Returning 404 to user: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:09:59.590851 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-392d578d-53aa-4ab7-8e32-a60ffdad6d52 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 404 len: 111 microversion: 2.20 time: 0.032083 May 19 15:09:59.590851 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 246/488] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:09:59 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 15:09:59.601545 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-edbfb7cf-7d0d-4e9b-9d71-8eeced58c54e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '.version_select at 0x7f35d1633a60>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:09:59.621715 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-edbfb7cf-7d0d-4e9b-9d71-8eeced58c54e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011669908" status: 204 len: 0 microversion: 2.20 time: 0.028119 May 19 15:09:59.622405 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 243/489] 10.222.0.24 () {60 vars in 1261 bytes} [Thu May 19 15:09:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011669908 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 19 15:10:00.473137 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1a4ff09a-397d-4cbf-af25-3bcc8f6eca2c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Action: 'create', calling method: .version_select at 0x7f35d1570550>, body: {"keypair": {"name": "tempest-keypair-1806985881", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIUGTNFNeuMsphdjyPleYtMLW5nyla4DYFoAJkXXuyLiqs3dI0ZG7Md+jidy+iPW0bD53BZ924TRl49T543GJOTvPExnOUVQUNfSwVasaVKU9SaPZteAc7qbq+eN7aF/A=="}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:00.488546 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-1a4ff09a-397d-4cbf-af25-3bcc8f6eca2c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Getting quotas for project edea803526e44a55b74472ecefdb0fbc. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:10:00.492428 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-1a4ff09a-397d-4cbf-af25-3bcc8f6eca2c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Getting quotas for user 644abe5583e94049abd23e4ca050a066 and project edea803526e44a55b74472ecefdb0fbc. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:10:00.515004 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1a4ff09a-397d-4cbf-af25-3bcc8f6eca2c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045744 May 19 15:10:00.515789 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 247/490] 10.222.0.24 () {62 vars in 1199 bytes} [Thu May 19 15:10:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 15:10:01.788020 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-10210103", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aaadbb67-bc9d-4c4f-a511-c571d677d8f0"}], "security_groups": [{"name": "tempest-securitygroup--275568993"}], "key_name": "tempest-keypair-1806985881", "user_data": "}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:01.894319 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.network.neutron [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] validate_networks() for [('aaadbb67-bc9d-4c4f-a511-c571d677d8f0', None, None, None, None, None)] {{(pid=117445) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:10:02.466950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Flavor limits 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:10:02.467423 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Image limits 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:10:02.467905 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Flavor pref 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:10:02.468319 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Image pref 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:10:02.468733 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:10:02.478252 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:02.478707 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:02.479552 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:02.479996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:02.497314 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Getting quotas for project edea803526e44a55b74472ecefdb0fbc. Resources: {'cores', 'instances', 'ram'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:10:02.501393 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Getting quotas for user 644abe5583e94049abd23e4ca050a066 and project edea803526e44a55b74472ecefdb0fbc. Resources: {'cores', 'instances', 'ram'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:10:02.514647 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Going to run 1 instances... {{(pid=117445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:10:02.517086 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:10:02.562438 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c40e0b82-187a-4384-9521-0df079afa2e3 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.779218 May 19 15:10:02.563098 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 244/491] 10.222.0.24 () {62 vars in 1187 bytes} [Thu May 19 15:10:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 15:10:02.573930 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-84e7bebc-1e20-4c9f-af5b-82aaa90ffc39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:02.574560 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-84e7bebc-1e20-4c9f-af5b-82aaa90ffc39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:02.632646 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-84e7bebc-1e20-4c9f-af5b-82aaa90ffc39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:02.640777 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-84e7bebc-1e20-4c9f-af5b-82aaa90ffc39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:02.642273 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-84e7bebc-1e20-4c9f-af5b-82aaa90ffc39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:02.643419 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-84e7bebc-1e20-4c9f-af5b-82aaa90ffc39 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1280 microversion: 2.20 time: 0.074223 May 19 15:10:02.643988 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 248/492] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:10:02 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:10:03.663923 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b4bd3106-11ba-434f-8098-898b485d66cb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:03.664545 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b4bd3106-11ba-434f-8098-898b485d66cb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:03.671481 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b4bd3106-11ba-434f-8098-898b485d66cb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:03.671934 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b4bd3106-11ba-434f-8098-898b485d66cb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:03.672703 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b4bd3106-11ba-434f-8098-898b485d66cb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:03.673141 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b4bd3106-11ba-434f-8098-898b485d66cb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:03.733881 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-b4bd3106-11ba-434f-8098-898b485d66cb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:03.741783 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-b4bd3106-11ba-434f-8098-898b485d66cb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:03.743290 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-b4bd3106-11ba-434f-8098-898b485d66cb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:03.744642 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-b4bd3106-11ba-434f-8098-898b485d66cb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1338 microversion: 2.20 time: 0.086693 May 19 15:10:03.745197 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 245/493] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:10:03 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1338 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:10:04.762453 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2d2cf8cc-870a-48e9-ab94-4be97732ce8c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:04.762963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2d2cf8cc-870a-48e9-ab94-4be97732ce8c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:04.783162 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2d2cf8cc-870a-48e9-ab94-4be97732ce8c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:04.794068 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2d2cf8cc-870a-48e9-ab94-4be97732ce8c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:04.795213 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2d2cf8cc-870a-48e9-ab94-4be97732ce8c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:04.795774 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2d2cf8cc-870a-48e9-ab94-4be97732ce8c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:04.950992 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2d2cf8cc-870a-48e9-ab94-4be97732ce8c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:04.967307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2d2cf8cc-870a-48e9-ab94-4be97732ce8c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:04.969016 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2d2cf8cc-870a-48e9-ab94-4be97732ce8c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:04.970238 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2d2cf8cc-870a-48e9-ab94-4be97732ce8c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1405 microversion: 2.20 time: 0.211733 May 19 15:10:04.970793 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 249/494] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:10:04 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:10:05.027633 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-e7e0a23f-3646-4f7b-a3f2-70a041f39a75 req-d934781e-f65a-4f12-b797-54977363bbbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7516d806-e895-4839-8142-5209040d1f2f", "tag": "31aad5e7-16b4-45c8-b12a-2912bed903a1"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:05.037087 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-e7e0a23f-3646-4f7b-a3f2-70a041f39a75 req-d934781e-f65a-4f12-b797-54977363bbbe service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:05.037892 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-e7e0a23f-3646-4f7b-a3f2-70a041f39a75 req-d934781e-f65a-4f12-b797-54977363bbbe service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:05.054094 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-e7e0a23f-3646-4f7b-a3f2-70a041f39a75 req-d934781e-f65a-4f12-b797-54977363bbbe service nova] Creating event network-changed:31aad5e7-16b4-45c8-b12a-2912bed903a1 for instance 7516d806-e895-4839-8142-5209040d1f2f on hv-cinder-82549 May 19 15:10:05.059278 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-e7e0a23f-3646-4f7b-a3f2-70a041f39a75 req-d934781e-f65a-4f12-b797-54977363bbbe service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035975 May 19 15:10:05.060602 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 246/495] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:05.987990 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7064c985-df42-41d9-895d-7c565b5cd72a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:05.988682 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7064c985-df42-41d9-895d-7c565b5cd72a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:05.996237 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7064c985-df42-41d9-895d-7c565b5cd72a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:05.996745 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7064c985-df42-41d9-895d-7c565b5cd72a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:05.997461 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7064c985-df42-41d9-895d-7c565b5cd72a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:05.997896 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7064c985-df42-41d9-895d-7c565b5cd72a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:06.130036 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7064c985-df42-41d9-895d-7c565b5cd72a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:06.138294 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7064c985-df42-41d9-895d-7c565b5cd72a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:06.139828 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7064c985-df42-41d9-895d-7c565b5cd72a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:06.140921 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7064c985-df42-41d9-895d-7c565b5cd72a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1405 microversion: 2.20 time: 0.156900 May 19 15:10:06.141778 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 250/496] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:10:05 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:10:07.161146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4e380193-dbfd-4881-b41e-497291455980 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:07.162410 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4e380193-dbfd-4881-b41e-497291455980 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:07.168817 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4e380193-dbfd-4881-b41e-497291455980 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:07.169273 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4e380193-dbfd-4881-b41e-497291455980 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:07.170047 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4e380193-dbfd-4881-b41e-497291455980 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:07.171117 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4e380193-dbfd-4881-b41e-497291455980 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:07.309848 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4e380193-dbfd-4881-b41e-497291455980 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:07.319225 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4e380193-dbfd-4881-b41e-497291455980 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:07.320915 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4e380193-dbfd-4881-b41e-497291455980 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:07.322043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4e380193-dbfd-4881-b41e-497291455980 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1405 microversion: 2.20 time: 0.165877 May 19 15:10:07.332171 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 247/497] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:10:07 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:10:08.340182 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b8db0be1-ab9f-4499-9568-75022645d993 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:08.340826 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b8db0be1-ab9f-4499-9568-75022645d993 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:08.347339 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b8db0be1-ab9f-4499-9568-75022645d993 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:08.347804 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b8db0be1-ab9f-4499-9568-75022645d993 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:08.348586 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b8db0be1-ab9f-4499-9568-75022645d993 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:08.349030 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b8db0be1-ab9f-4499-9568-75022645d993 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:08.481418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b8db0be1-ab9f-4499-9568-75022645d993 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:08.490902 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b8db0be1-ab9f-4499-9568-75022645d993 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:08.492859 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b8db0be1-ab9f-4499-9568-75022645d993 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:08.494477 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b8db0be1-ab9f-4499-9568-75022645d993 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1405 microversion: 2.20 time: 0.158495 May 19 15:10:08.495038 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 251/498] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:10:08 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:10:09.512363 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a525646a-3b84-478e-8232-23313b549dda tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:09.513884 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-a525646a-3b84-478e-8232-23313b549dda tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:09.520588 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a525646a-3b84-478e-8232-23313b549dda tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:09.521913 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a525646a-3b84-478e-8232-23313b549dda tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:09.522930 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a525646a-3b84-478e-8232-23313b549dda tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:09.523697 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a525646a-3b84-478e-8232-23313b549dda tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:09.679340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-a525646a-3b84-478e-8232-23313b549dda tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:09.687835 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-a525646a-3b84-478e-8232-23313b549dda tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:09.691240 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-a525646a-3b84-478e-8232-23313b549dda tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:09.694201 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-a525646a-3b84-478e-8232-23313b549dda tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1405 microversion: 2.20 time: 0.185080 May 19 15:10:09.703474 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 248/499] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:10:09 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:10:10.713548 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-92d50cbc-6d5a-4142-9839-6a9fe01f99d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:10.714274 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-92d50cbc-6d5a-4142-9839-6a9fe01f99d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:10.720907 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-92d50cbc-6d5a-4142-9839-6a9fe01f99d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:10.721601 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-92d50cbc-6d5a-4142-9839-6a9fe01f99d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:10.722586 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-92d50cbc-6d5a-4142-9839-6a9fe01f99d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:10.723267 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-92d50cbc-6d5a-4142-9839-6a9fe01f99d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:10.878391 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-92d50cbc-6d5a-4142-9839-6a9fe01f99d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:10.887707 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-92d50cbc-6d5a-4142-9839-6a9fe01f99d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:10.889305 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-92d50cbc-6d5a-4142-9839-6a9fe01f99d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:10.890755 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-92d50cbc-6d5a-4142-9839-6a9fe01f99d1 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1405 microversion: 2.20 time: 0.181769 May 19 15:10:10.891409 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 252/500] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:10:10 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:10:11.561872 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-f8c31540-7db5-415f-a2f3-6ce056de824d req-c205a194-5e4b-413e-8c73-db1b49323c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7516d806-e895-4839-8142-5209040d1f2f", "name": "network-vif-plugged", "status": "completed", "tag": "31aad5e7-16b4-45c8-b12a-2912bed903a1"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:11.571732 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-f8c31540-7db5-415f-a2f3-6ce056de824d req-c205a194-5e4b-413e-8c73-db1b49323c60 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:11.572351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-f8c31540-7db5-415f-a2f3-6ce056de824d req-c205a194-5e4b-413e-8c73-db1b49323c60 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:11.586851 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-f8c31540-7db5-415f-a2f3-6ce056de824d req-c205a194-5e4b-413e-8c73-db1b49323c60 service nova] Creating event network-vif-plugged:31aad5e7-16b4-45c8-b12a-2912bed903a1 for instance 7516d806-e895-4839-8142-5209040d1f2f on hv-cinder-82549 May 19 15:10:11.592227 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-f8c31540-7db5-415f-a2f3-6ce056de824d req-c205a194-5e4b-413e-8c73-db1b49323c60 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036438 May 19 15:10:11.592724 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 249/501] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:11.909729 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0fd9d463-d227-4908-8e50-755bbf7fec00 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:11.910601 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0fd9d463-d227-4908-8e50-755bbf7fec00 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:11.925425 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0fd9d463-d227-4908-8e50-755bbf7fec00 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:11.926259 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0fd9d463-d227-4908-8e50-755bbf7fec00 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:11.927266 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0fd9d463-d227-4908-8e50-755bbf7fec00 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:11.927744 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0fd9d463-d227-4908-8e50-755bbf7fec00 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:12.117112 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0fd9d463-d227-4908-8e50-755bbf7fec00 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:12.126155 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0fd9d463-d227-4908-8e50-755bbf7fec00 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:12.128191 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0fd9d463-d227-4908-8e50-755bbf7fec00 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:12.129703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0fd9d463-d227-4908-8e50-755bbf7fec00 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1405 microversion: 2.20 time: 0.224092 May 19 15:10:12.130884 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 253/502] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:10:11 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:10:13.145268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=2 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:13.147257 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=6 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:13.152309 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-8b589300-88b3-4ce0-9437-d5c26f061e8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:13.153212 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-8b589300-88b3-4ce0-9437-d5c26f061e8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:13.161049 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8b589300-88b3-4ce0-9437-d5c26f061e8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:13.162583 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8b589300-88b3-4ce0-9437-d5c26f061e8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:13.163520 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8b589300-88b3-4ce0-9437-d5c26f061e8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:13.164061 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8b589300-88b3-4ce0-9437-d5c26f061e8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:13.311742 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8b589300-88b3-4ce0-9437-d5c26f061e8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:13.322698 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8b589300-88b3-4ce0-9437-d5c26f061e8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:13.324471 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8b589300-88b3-4ce0-9437-d5c26f061e8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:13.325784 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-8b589300-88b3-4ce0-9437-d5c26f061e8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1405 microversion: 2.20 time: 0.181658 May 19 15:10:13.326358 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 250/503] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:10:13 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:10:14.344175 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0dc37042-e298-4b9c-b391-94f4342c831a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:14.345676 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0dc37042-e298-4b9c-b391-94f4342c831a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:14.351928 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:14.354721 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0dc37042-e298-4b9c-b391-94f4342c831a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:14.355762 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0dc37042-e298-4b9c-b391-94f4342c831a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:14.356689 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0dc37042-e298-4b9c-b391-94f4342c831a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:14.357331 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0dc37042-e298-4b9c-b391-94f4342c831a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:14.561680 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0dc37042-e298-4b9c-b391-94f4342c831a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:14.571574 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0dc37042-e298-4b9c-b391-94f4342c831a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:14.573174 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0dc37042-e298-4b9c-b391-94f4342c831a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:14.574614 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0dc37042-e298-4b9c-b391-94f4342c831a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1596 microversion: 2.20 time: 0.234520 May 19 15:10:14.575737 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 254/504] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:10:14 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1596 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:10:14.596494 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ede1787c-e262-4617-8836-c8b02d001c54 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:14.597076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ede1787c-e262-4617-8836-c8b02d001c54 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:14.604335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ede1787c-e262-4617-8836-c8b02d001c54 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:14.604792 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ede1787c-e262-4617-8836-c8b02d001c54 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:14.605576 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ede1787c-e262-4617-8836-c8b02d001c54 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:14.611239 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ede1787c-e262-4617-8836-c8b02d001c54 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:14.735701 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ede1787c-e262-4617-8836-c8b02d001c54 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.146182 May 19 15:10:14.736291 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 251/505] 10.222.0.24 () {60 vars in 1315 bytes} [Thu May 19 15:10:14 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 15:10:16.298475 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-4906ea18-3af4-4084-b6b0-d46550f79bbe req-36d34251-8439-4572-b18e-c6e3910ade4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7516d806-e895-4839-8142-5209040d1f2f", "tag": "31aad5e7-16b4-45c8-b12a-2912bed903a1"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:16.308799 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-4906ea18-3af4-4084-b6b0-d46550f79bbe req-36d34251-8439-4572-b18e-c6e3910ade4b service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:16.309246 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-4906ea18-3af4-4084-b6b0-d46550f79bbe req-36d34251-8439-4572-b18e-c6e3910ade4b service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:16.349131 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-4906ea18-3af4-4084-b6b0-d46550f79bbe req-36d34251-8439-4572-b18e-c6e3910ade4b service nova] Creating event network-changed:31aad5e7-16b4-45c8-b12a-2912bed903a1 for instance 7516d806-e895-4839-8142-5209040d1f2f on hv-cinder-82549 May 19 15:10:16.360503 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-4906ea18-3af4-4084-b6b0-d46550f79bbe req-36d34251-8439-4572-b18e-c6e3910ade4b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075931 May 19 15:10:16.361227 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 252/506] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 19 15:10:16.529376 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e94eeafc-f9a1-4c27-b258-0f54a0e94f3e tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Action: 'create', calling method: .version_select at 0x7f35d135e4c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-889694620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRx4P9TMHhXfWY6gV0OBLqsHQHVyJTUAsuKbrgZoMYGyHwU8U33MAaoVp0KxSLslhiWkiyFyps2Ytb690OwSdcRc9AV8eCzLrrBP1OGJgBY+IFzNL25TMm2wPtj7mYsbg=="}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:16.559455 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-e94eeafc-f9a1-4c27-b258-0f54a0e94f3e tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Getting quotas for project ee9ba7310e7e4d558dba77f08668b77b. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:10:16.567482 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-e94eeafc-f9a1-4c27-b258-0f54a0e94f3e tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Getting quotas for user 48e29cb55f7d4acabfc451e996b07791 and project ee9ba7310e7e4d558dba77f08668b77b. Resources: {'key_pairs'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:10:16.639523 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e94eeafc-f9a1-4c27-b258-0f54a0e94f3e tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.401968 May 19 15:10:16.640466 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 255/507] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 15:10:16 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:16.813723 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f2f928ec-ff67-4d12-b287-d6dbfdbbfbf0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:16.814493 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f2f928ec-ff67-4d12-b287-d6dbfdbbfbf0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:16.830310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f2f928ec-ff67-4d12-b287-d6dbfdbbfbf0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:16.837509 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f2f928ec-ff67-4d12-b287-d6dbfdbbfbf0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:16.841053 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f2f928ec-ff67-4d12-b287-d6dbfdbbfbf0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:16.841696 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f2f928ec-ff67-4d12-b287-d6dbfdbbfbf0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:17.004915 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-f2f928ec-ff67-4d12-b287-d6dbfdbbfbf0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lazy-loading 'services' on Instance uuid 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:10:17.153151 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f2f928ec-ff67-4d12-b287-d6dbfdbbfbf0 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/os-volume_attachments/c8e53055-9fa2-438b-82b9-e60595767ee8" status: 202 len: 0 microversion: 2.1 time: 0.344115 May 19 15:10:17.172131 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 253/508] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 15:10:16 2022] DELETE /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/os-volume_attachments/c8e53055-9fa2-438b-82b9-e60595767ee8 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:10:17.183639 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-bdee40ec-c0f8-4ef8-a612-aee6b2dc62f3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:17.185052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bdee40ec-c0f8-4ef8-a612-aee6b2dc62f3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:17.219049 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bdee40ec-c0f8-4ef8-a612-aee6b2dc62f3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:17.220477 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bdee40ec-c0f8-4ef8-a612-aee6b2dc62f3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:17.225444 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bdee40ec-c0f8-4ef8-a612-aee6b2dc62f3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:17.227503 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bdee40ec-c0f8-4ef8-a612-aee6b2dc62f3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:17.357991 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-bdee40ec-c0f8-4ef8-a612-aee6b2dc62f3 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.180983 May 19 15:10:17.362779 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 256/509] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:10:17 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:18.379419 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-36affc3f-fea7-43d1-b21c-df8fdc6a4950 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:18.382341 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-36affc3f-fea7-43d1-b21c-df8fdc6a4950 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:18.394340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-36affc3f-fea7-43d1-b21c-df8fdc6a4950 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:18.394956 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-36affc3f-fea7-43d1-b21c-df8fdc6a4950 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:18.396519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-36affc3f-fea7-43d1-b21c-df8fdc6a4950 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:18.398057 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-36affc3f-fea7-43d1-b21c-df8fdc6a4950 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:18.438791 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-36affc3f-fea7-43d1-b21c-df8fdc6a4950 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067505 May 19 15:10:18.440081 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 254/510] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:10:18 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 15:10:18.528060 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-49a061f5-f772-4570-9101-056265db1940 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:18.529441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-49a061f5-f772-4570-9101-056265db1940 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:18.536291 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49a061f5-f772-4570-9101-056265db1940 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:18.537704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49a061f5-f772-4570-9101-056265db1940 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:18.538572 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49a061f5-f772-4570-9101-056265db1940 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:18.539111 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49a061f5-f772-4570-9101-056265db1940 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:18.574571 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-49a061f5-f772-4570-9101-056265db1940 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:10:18.700771 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-49a061f5-f772-4570-9101-056265db1940 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "DELETE /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 204 len: 0 microversion: 2.1 time: 0.177744 May 19 15:10:18.701581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 257/511] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:10:18 2022] DELETE /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:10:18.710399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a2ce7a5b-be60-4f5f-b625-a482a7f4551b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:18.711878 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-a2ce7a5b-be60-4f5f-b625-a482a7f4551b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:18.717971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a2ce7a5b-be60-4f5f-b625-a482a7f4551b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:18.718425 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a2ce7a5b-be60-4f5f-b625-a482a7f4551b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:18.719231 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a2ce7a5b-be60-4f5f-b625-a482a7f4551b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:18.719665 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a2ce7a5b-be60-4f5f-b625-a482a7f4551b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:18.873946 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-a2ce7a5b-be60-4f5f-b625-a482a7f4551b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:18.885898 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-a2ce7a5b-be60-4f5f-b625-a482a7f4551b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1689 microversion: 2.1 time: 0.179839 May 19 15:10:18.886525 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 255/512] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:18 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:19.904955 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7aaa44ae-194a-492b-99d9-96b26e0eb22f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:19.906401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7aaa44ae-194a-492b-99d9-96b26e0eb22f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:19.913487 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7aaa44ae-194a-492b-99d9-96b26e0eb22f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:19.914292 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7aaa44ae-194a-492b-99d9-96b26e0eb22f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:19.915460 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7aaa44ae-194a-492b-99d9-96b26e0eb22f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:19.916095 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7aaa44ae-194a-492b-99d9-96b26e0eb22f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:20.085481 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7aaa44ae-194a-492b-99d9-96b26e0eb22f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:20.093700 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7aaa44ae-194a-492b-99d9-96b26e0eb22f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1689 microversion: 2.1 time: 0.193585 May 19 15:10:20.094379 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 258/513] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:19 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:21.114729 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-51f68560-94e2-4f76-b94d-4804c1f3bcd9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:21.115320 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-51f68560-94e2-4f76-b94d-4804c1f3bcd9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:21.122093 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-51f68560-94e2-4f76-b94d-4804c1f3bcd9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:21.122550 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-51f68560-94e2-4f76-b94d-4804c1f3bcd9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:21.123364 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-51f68560-94e2-4f76-b94d-4804c1f3bcd9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:21.123806 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-51f68560-94e2-4f76-b94d-4804c1f3bcd9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:21.259523 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-51f68560-94e2-4f76-b94d-4804c1f3bcd9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:21.263016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:21.267805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-51f68560-94e2-4f76-b94d-4804c1f3bcd9 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1689 microversion: 2.1 time: 0.157718 May 19 15:10:21.268369 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 256/514] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:21 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:22.284728 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d990b1a2-ebc9-49b0-a79e-280d5581d194 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:22.285376 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d990b1a2-ebc9-49b0-a79e-280d5581d194 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:22.292023 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d990b1a2-ebc9-49b0-a79e-280d5581d194 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:22.292477 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d990b1a2-ebc9-49b0-a79e-280d5581d194 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:22.293248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d990b1a2-ebc9-49b0-a79e-280d5581d194 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:22.293691 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d990b1a2-ebc9-49b0-a79e-280d5581d194 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:22.423519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d990b1a2-ebc9-49b0-a79e-280d5581d194 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:22.427012 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:22.432104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d990b1a2-ebc9-49b0-a79e-280d5581d194 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1689 microversion: 2.1 time: 0.151281 May 19 15:10:22.432664 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 259/515] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:22 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:23.457137 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-654912d5-b281-4dad-a885-673fb8ff36cb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:23.457137 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-654912d5-b281-4dad-a885-673fb8ff36cb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:23.464801 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-044fb9e9-9274-48ea-890b-327b62b6fcb6 req-eace1188-d960-468c-9d81-9812c9ee891f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b30b6fd-1ba9-4939-baeb-d0fb305b1176", "name": "network-vif-deleted", "tag": "7377972f-e26c-43d1-ac62-ddf4b52e4bfd"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:23.479855 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-654912d5-b281-4dad-a885-673fb8ff36cb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:23.480588 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-654912d5-b281-4dad-a885-673fb8ff36cb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:23.481599 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-654912d5-b281-4dad-a885-673fb8ff36cb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:23.482420 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-654912d5-b281-4dad-a885-673fb8ff36cb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:23.482658 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-044fb9e9-9274-48ea-890b-327b62b6fcb6 req-eace1188-d960-468c-9d81-9812c9ee891f service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:23.483187 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-044fb9e9-9274-48ea-890b-327b62b6fcb6 req-eace1188-d960-468c-9d81-9812c9ee891f service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:23.500042 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-044fb9e9-9274-48ea-890b-327b62b6fcb6 req-eace1188-d960-468c-9d81-9812c9ee891f service nova] Creating event network-vif-deleted:7377972f-e26c-43d1-ac62-ddf4b52e4bfd for instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 on hv-cinder-82549 May 19 15:10:23.506008 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-044fb9e9-9274-48ea-890b-327b62b6fcb6 req-eace1188-d960-468c-9d81-9812c9ee891f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044780 May 19 15:10:23.509654 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 260/516] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:23.591336 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-654912d5-b281-4dad-a885-673fb8ff36cb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:23.606420 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-654912d5-b281-4dad-a885-673fb8ff36cb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 200 len: 1621 microversion: 2.1 time: 0.160378 May 19 15:10:23.627465 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 257/517] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:23 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 1621 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:23.967253 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ae92427f-93d3-4067-bb68-ac3cfa5c9244 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:23.968251 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ae92427f-93d3-4067-bb68-ac3cfa5c9244 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:23.975893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ae92427f-93d3-4067-bb68-ac3cfa5c9244 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:23.976358 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ae92427f-93d3-4067-bb68-ac3cfa5c9244 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:23.977180 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ae92427f-93d3-4067-bb68-ac3cfa5c9244 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:23.977631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ae92427f-93d3-4067-bb68-ac3cfa5c9244 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:24.005563 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ae92427f-93d3-4067-bb68-ac3cfa5c9244 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/ips" status: 200 len: 149 microversion: 2.1 time: 0.042546 May 19 15:10:24.006983 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 261/518] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 15:10:23 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:24.639387 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-0f695861-2702-4515-9870-4b88e727a14b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:24.640007 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-0f695861-2702-4515-9870-4b88e727a14b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 9b30b6fd-1ba9-4939-baeb-d0fb305b1176] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:24.643320 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:24.648071 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0f695861-2702-4515-9870-4b88e727a14b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:24.648525 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0f695861-2702-4515-9870-4b88e727a14b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:24.649297 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0f695861-2702-4515-9870-4b88e727a14b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:24.649733 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-0f695861-2702-4515-9870-4b88e727a14b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:24.665720 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-0f695861-2702-4515-9870-4b88e727a14b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] HTTP exception thrown: Instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 could not be found. May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-0f695861-2702-4515-9870-4b88e727a14b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Request method failure captured: May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 HTTP/1.1 May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihlzDaKprO0909qPKc4F_OazQwwc5_Rbafbmht_l8WXneyGFtInLfgtI9qenFfnQFlXMiKiG_mNerNQSxrT4phnzSvWe7hKeozkgWzbgSMTg6jjqWsZx06axD917IRiSdc6jQEGzZZbBsd1kyhzNheIUk6IECPe14kqEerVf8vh7H9Tk May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 199f08479d9541bc936bb4ea80bae96a May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-632949355 May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:10:24.667413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:10:24.668936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_199f08479d9541bc936bb4ea80bae96a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/199f08479d9541bc936bb4ea80bae96a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/199f08479d9541bc936bb4ea80bae96a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/199f08479d9541bc936bb4ea80bae96a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:10:24.668936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-ServerRescueNegativeTestJSON-632949355 May 19 15:10:24.668936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 199f08479d9541bc936bb4ea80bae96a May 19 15:10:24.668936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-632949355 May 19 15:10:24.668936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-ServerRescueNegativeTestJSON-632949355-project May 19 15:10:24.668936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:10:24.668936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:10:24.668936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: e5374c90f38b47fcb611e346f3f2ec69 May 19 15:10:24.668936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-ServerRescueNegativeTestJSON-632949355-project May 19 15:10:24.668936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:10:24.668936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 could not be found. May 19 15:10:24.668936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '9b30b6fd-1ba9-4939-baeb-d0fb305b1176'} May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 could not be found. May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:10:24.669865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 could not be found. May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 could not be found. May 19 15:10:24.671335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:24.672722 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-0f695861-2702-4515-9870-4b88e727a14b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Returning 404 to user: Instance 9b30b6fd-1ba9-4939-baeb-d0fb305b1176 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:10:24.672722 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-0f695861-2702-4515-9870-4b88e727a14b tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176" status: 404 len: 111 microversion: 2.1 time: 0.033376 May 19 15:10:24.672722 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 258/519] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:24 2022] GET /compute/v2.1/servers/9b30b6fd-1ba9-4939-baeb-d0fb305b1176 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:10:24.678028 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-aa31d9a0-62fb-4c12-b63c-4951bb3edf19 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '.version_select at 0x7f35d13a9040>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:24.689191 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:24.697160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-aa31d9a0-62fb-4c12-b63c-4951bb3edf19 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128424100" status: 202 len: 0 microversion: 2.1 time: 0.023096 May 19 15:10:24.697756 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 262/520] 10.222.0.24 () {58 vars in 1220 bytes} [Thu May 19 15:10:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128424100 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:10:25.371372 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e155d57d-b153-4085-bb4f-74f8c75fc243 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9eb91373-6f5d-4752-b33f-d91dfc4a83fa"}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:25.372430 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e155d57d-b153-4085-bb4f-74f8c75fc243 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:25.378468 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e155d57d-b153-4085-bb4f-74f8c75fc243 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:25.378916 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e155d57d-b153-4085-bb4f-74f8c75fc243 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:25.379694 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e155d57d-b153-4085-bb4f-74f8c75fc243 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:25.380129 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e155d57d-b153-4085-bb4f-74f8c75fc243 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:25.641234 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e155d57d-b153-4085-bb4f-74f8c75fc243 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "POST /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275016 May 19 15:10:25.641872 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 259/521] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 15:10:25 2022] POST /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:27.789488 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=4 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:27.794017 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-997e73c7-8cf0-4eb6-b0f2-d8146619ad39 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:27.794522 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-997e73c7-8cf0-4eb6-b0f2-d8146619ad39 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:27.802188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-997e73c7-8cf0-4eb6-b0f2-d8146619ad39 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:27.803328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-997e73c7-8cf0-4eb6-b0f2-d8146619ad39 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:27.804164 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-997e73c7-8cf0-4eb6-b0f2-d8146619ad39 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:27.804668 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-997e73c7-8cf0-4eb6-b0f2-d8146619ad39 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:27.829014 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-997e73c7-8cf0-4eb6-b0f2-d8146619ad39 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:10:27.905627 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-997e73c7-8cf0-4eb6-b0f2-d8146619ad39 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "DELETE /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 204 len: 0 microversion: 2.1 time: 0.116997 May 19 15:10:27.906227 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 263/522] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:10:27 2022] DELETE /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:10:27.916432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-58c5dd54-ec53-445c-b8f7-c6ac41aac409 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:27.917900 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-58c5dd54-ec53-445c-b8f7-c6ac41aac409 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:27.924355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-58c5dd54-ec53-445c-b8f7-c6ac41aac409 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:27.924803 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-58c5dd54-ec53-445c-b8f7-c6ac41aac409 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:27.925574 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-58c5dd54-ec53-445c-b8f7-c6ac41aac409 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:27.926011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-58c5dd54-ec53-445c-b8f7-c6ac41aac409 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:28.057112 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-58c5dd54-ec53-445c-b8f7-c6ac41aac409 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:28.064620 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-58c5dd54-ec53-445c-b8f7-c6ac41aac409 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1507 microversion: 2.1 time: 0.153935 May 19 15:10:28.065186 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 260/523] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:27 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:29.082035 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cce447b4-7a09-4353-934d-8e1f3ab43492 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:29.082662 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cce447b4-7a09-4353-934d-8e1f3ab43492 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:29.089452 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cce447b4-7a09-4353-934d-8e1f3ab43492 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:29.089914 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cce447b4-7a09-4353-934d-8e1f3ab43492 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:29.090712 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cce447b4-7a09-4353-934d-8e1f3ab43492 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:29.091151 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cce447b4-7a09-4353-934d-8e1f3ab43492 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:29.324364 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cce447b4-7a09-4353-934d-8e1f3ab43492 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:29.331936 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cce447b4-7a09-4353-934d-8e1f3ab43492 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1507 microversion: 2.1 time: 0.254210 May 19 15:10:29.332559 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 264/524] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:29 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1507 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:30.349083 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-19afd779-5b0a-4708-b74f-f75e0f9652f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:30.349908 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-19afd779-5b0a-4708-b74f-f75e0f9652f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:30.356534 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-19afd779-5b0a-4708-b74f-f75e0f9652f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:30.356994 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-19afd779-5b0a-4708-b74f-f75e0f9652f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:30.357768 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-19afd779-5b0a-4708-b74f-f75e0f9652f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:30.358214 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-19afd779-5b0a-4708-b74f-f75e0f9652f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:30.536890 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-19afd779-5b0a-4708-b74f-f75e0f9652f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:30.544529 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-19afd779-5b0a-4708-b74f-f75e0f9652f8 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1507 microversion: 2.1 time: 0.199352 May 19 15:10:30.545425 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 261/525] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:30 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:30.816540 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-096a891e-ac2b-41da-acb8-1f1ff2e168e1 req-e29dc344-eee3-4ceb-84d1-3153debfa66b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40f607ee-2d96-4574-bed0-1462c869a91d", "name": "network-vif-deleted", "tag": "60b6f5c8-3ba6-433a-ab56-de26c095f559"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:30.827690 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-096a891e-ac2b-41da-acb8-1f1ff2e168e1 req-e29dc344-eee3-4ceb-84d1-3153debfa66b service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:30.828176 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-096a891e-ac2b-41da-acb8-1f1ff2e168e1 req-e29dc344-eee3-4ceb-84d1-3153debfa66b service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:30.839815 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-096a891e-ac2b-41da-acb8-1f1ff2e168e1 req-e29dc344-eee3-4ceb-84d1-3153debfa66b service nova] Creating event network-vif-deleted:60b6f5c8-3ba6-433a-ab56-de26c095f559 for instance 40f607ee-2d96-4574-bed0-1462c869a91d on hv-cinder-82549 May 19 15:10:30.845063 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-096a891e-ac2b-41da-acb8-1f1ff2e168e1 req-e29dc344-eee3-4ceb-84d1-3153debfa66b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032746 May 19 15:10:30.845658 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 265/526] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:31.561864 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c420ce27-628c-4ed7-9f0c-aa49fe146388 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:31.562384 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c420ce27-628c-4ed7-9f0c-aa49fe146388 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:31.569492 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c420ce27-628c-4ed7-9f0c-aa49fe146388 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:31.569936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c420ce27-628c-4ed7-9f0c-aa49fe146388 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:31.570697 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c420ce27-628c-4ed7-9f0c-aa49fe146388 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:31.571128 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c420ce27-628c-4ed7-9f0c-aa49fe146388 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:31.602438 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c420ce27-628c-4ed7-9f0c-aa49fe146388 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:31.602880 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c420ce27-628c-4ed7-9f0c-aa49fe146388 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:31.603359 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-c420ce27-628c-4ed7-9f0c-aa49fe146388 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lazy-loading 'fault' on Instance uuid 40f607ee-2d96-4574-bed0-1462c869a91d {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:10:31.656276 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c420ce27-628c-4ed7-9f0c-aa49fe146388 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:31.664927 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c420ce27-628c-4ed7-9f0c-aa49fe146388 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 200 len: 1312 microversion: 2.1 time: 0.106982 May 19 15:10:31.666059 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 262/527] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:31 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:32.683345 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-adbac3d7-a9ac-4932-b33f-b7f90108283c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:32.684041 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-adbac3d7-a9ac-4932-b33f-b7f90108283c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 40f607ee-2d96-4574-bed0-1462c869a91d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:32.690151 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-adbac3d7-a9ac-4932-b33f-b7f90108283c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:32.690600 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-adbac3d7-a9ac-4932-b33f-b7f90108283c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:32.691394 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-adbac3d7-a9ac-4932-b33f-b7f90108283c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:32.691828 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-adbac3d7-a9ac-4932-b33f-b7f90108283c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:32.705222 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-adbac3d7-a9ac-4932-b33f-b7f90108283c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] HTTP exception thrown: Instance 40f607ee-2d96-4574-bed0-1462c869a91d could not be found. May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-adbac3d7-a9ac-4932-b33f-b7f90108283c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Request method failure captured: May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d HTTP/1.1 May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihlzDaKprO0909qPKc4F_OazQwwc5_Rbafbmht_l8WXneyGFtInLfgtI9qenFfnQFlXMiKiG_mNerNQSxrT4phnzSvWe7hKeozkgWzbgSMTg6jjqWsZx06axD917IRiSdc6jQEGzZZbBsd1kyhzNheIUk6IECPe14kqEerVf8vh7H9Tk May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 199f08479d9541bc936bb4ea80bae96a May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-632949355 May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:10:32.706783 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:10:32.708299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_199f08479d9541bc936bb4ea80bae96a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/199f08479d9541bc936bb4ea80bae96a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/199f08479d9541bc936bb4ea80bae96a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/199f08479d9541bc936bb4ea80bae96a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:10:32.708299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-ServerRescueNegativeTestJSON-632949355 May 19 15:10:32.708299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 199f08479d9541bc936bb4ea80bae96a May 19 15:10:32.708299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-632949355 May 19 15:10:32.708299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-ServerRescueNegativeTestJSON-632949355-project May 19 15:10:32.708299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:10:32.708299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:10:32.708299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: e5374c90f38b47fcb611e346f3f2ec69 May 19 15:10:32.708299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-ServerRescueNegativeTestJSON-632949355-project May 19 15:10:32.708299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:10:32.708299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance 40f607ee-2d96-4574-bed0-1462c869a91d could not be found. May 19 15:10:32.708299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': '40f607ee-2d96-4574-bed0-1462c869a91d'} May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40f607ee-2d96-4574-bed0-1462c869a91d could not be found. May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:10:32.709121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40f607ee-2d96-4574-bed0-1462c869a91d could not be found. May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40f607ee-2d96-4574-bed0-1462c869a91d could not be found. May 19 15:10:32.710504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:10:32.711817 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-adbac3d7-a9ac-4932-b33f-b7f90108283c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Returning 404 to user: Instance 40f607ee-2d96-4574-bed0-1462c869a91d could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:10:32.711817 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-adbac3d7-a9ac-4932-b33f-b7f90108283c tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d" status: 404 len: 111 microversion: 2.1 time: 0.029594 May 19 15:10:32.711817 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 266/528] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:32 2022] GET /compute/v2.1/servers/40f607ee-2d96-4574-bed0-1462c869a91d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:10:32.716560 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-2149c969-a8e8-4048-b963-2da989db5d66 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:32.717058 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-2149c969-a8e8-4048-b963-2da989db5d66 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:32.723471 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2149c969-a8e8-4048-b963-2da989db5d66 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:32.723926 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2149c969-a8e8-4048-b963-2da989db5d66 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:32.724726 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2149c969-a8e8-4048-b963-2da989db5d66 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:32.725171 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2149c969-a8e8-4048-b963-2da989db5d66 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:32.750037 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-2149c969-a8e8-4048-b963-2da989db5d66 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Going to try to terminate instance {{(pid=117445) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:10:32.825768 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-2149c969-a8e8-4048-b963-2da989db5d66 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "DELETE /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 204 len: 0 microversion: 2.1 time: 0.112717 May 19 15:10:32.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 263/529] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:10:32 2022] DELETE /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 15:10:32.834490 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-badc599d-59d1-485f-9005-6879b9c2d978 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:32.835097 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-badc599d-59d1-485f-9005-6879b9c2d978 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:32.841072 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-badc599d-59d1-485f-9005-6879b9c2d978 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:32.841520 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-badc599d-59d1-485f-9005-6879b9c2d978 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:32.842274 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-badc599d-59d1-485f-9005-6879b9c2d978 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:32.842708 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-badc599d-59d1-485f-9005-6879b9c2d978 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:32.972733 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-badc599d-59d1-485f-9005-6879b9c2d978 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:32.980784 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-badc599d-59d1-485f-9005-6879b9c2d978 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.150226 May 19 15:10:32.981338 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 267/530] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:32 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:33.163426 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4e287eb0-33ea-49bb-b4e0-ad28ad0a1f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9eb91373-6f5d-4752-b33f-d91dfc4a83fa"}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:33.164668 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4e287eb0-33ea-49bb-b4e0-ad28ad0a1f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:33.170569 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4e287eb0-33ea-49bb-b4e0-ad28ad0a1f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:33.171022 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4e287eb0-33ea-49bb-b4e0-ad28ad0a1f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:33.171824 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4e287eb0-33ea-49bb-b4e0-ad28ad0a1f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:33.172267 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4e287eb0-33ea-49bb-b4e0-ad28ad0a1f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:33.249934 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-4e287eb0-33ea-49bb-b4e0-ad28ad0a1f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] HTTP exception thrown: Invalid volume: volume 9eb91373-6f5d-4752-b33f-d91dfc4a83fa is already attached to instances: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4e287eb0-33ea-49bb-b4e0-ad28ad0a1f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Request method failure captured: May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: POST /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-volume_attachments HTTP/1.1 May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 74 May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihlzC36TVjbhLtU3g9xMp125AwUSov1duWZll1n5H-S_HScG7MruR7Gs1GViXAQd0SIJut8uotHNInm1_M2FBmXP1RayH0EJZ45YHoedSq6oTnynPABMFxjsri0-n9qTagsLk52YqxiHKDUiWNSXW6fHPq-ckGn5xy8R26VrSRWiq2XI May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:10:33.251684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:10:33.253222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_34c1099557144b8bb2fff88f5b526834", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:10:33.253222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:10:33.253222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:10:33.253222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:10:33.253222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:10:33.253222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:10:33.253222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:10:33.253222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: af7838e525a042dfa0357ad1fc58cf21 May 19 15:10:33.253222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:10:33.253222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: May 19 15:10:33.253222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {"volumeAttachment": {"volumeId": "9eb91373-6f5d-4752-b33f-d91dfc4a83fa"}} May 19 15:10:33.253222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Invalid volume: volume 9eb91373-6f5d-4752-b33f-d91dfc4a83fa is already attached to instances: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'server_id': 'b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f', 'body': {'volumeAttachment': {'volumeId': '9eb91373-6f5d-4752-b33f-d91dfc4a83fa'}}} May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9eb91373-6f5d-4752-b33f-d91dfc4a83fa is already attached to instances: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:33.254064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9eb91373-6f5d-4752-b33f-d91dfc4a83fa is already attached to instances: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:10:33.255487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:10:33.256922 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:10:33.256922 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:10:33.256922 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:10:33.256922 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9eb91373-6f5d-4752-b33f-d91dfc4a83fa is already attached to instances: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f May 19 15:10:33.256922 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:33.256922 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4e287eb0-33ea-49bb-b4e0-ad28ad0a1f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Returning 400 to user: Invalid volume: volume 9eb91373-6f5d-4752-b33f-d91dfc4a83fa is already attached to instances: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:10:33.256922 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4e287eb0-33ea-49bb-b4e0-ad28ad0a1f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "POST /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094616 May 19 15:10:33.256922 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 264/531] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 15:10:33 2022] POST /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 15:10:33.317779 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-217ce57e-05ad-4ee7-8dcc-1f6f3347b148 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:33.318276 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-217ce57e-05ad-4ee7-8dcc-1f6f3347b148 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:33.324280 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-217ce57e-05ad-4ee7-8dcc-1f6f3347b148 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:33.324718 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-217ce57e-05ad-4ee7-8dcc-1f6f3347b148 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:33.325484 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-217ce57e-05ad-4ee7-8dcc-1f6f3347b148 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:33.325922 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-217ce57e-05ad-4ee7-8dcc-1f6f3347b148 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:33.407877 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-217ce57e-05ad-4ee7-8dcc-1f6f3347b148 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lazy-loading 'services' on Instance uuid b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:10:33.480692 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-217ce57e-05ad-4ee7-8dcc-1f6f3347b148 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-volume_attachments/9eb91373-6f5d-4752-b33f-d91dfc4a83fa" status: 202 len: 0 microversion: 2.1 time: 0.166631 May 19 15:10:33.481306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 268/532] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 15:10:33 2022] DELETE /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-volume_attachments/9eb91373-6f5d-4752-b33f-d91dfc4a83fa => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:10:33.489682 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-14ddeafe-6724-458a-9486-7528befdfc73 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:33.490617 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-14ddeafe-6724-458a-9486-7528befdfc73 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:33.497783 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-14ddeafe-6724-458a-9486-7528befdfc73 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:33.498238 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-14ddeafe-6724-458a-9486-7528befdfc73 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:33.499011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-14ddeafe-6724-458a-9486-7528befdfc73 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:33.499478 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-14ddeafe-6724-458a-9486-7528befdfc73 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:33.527925 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-14ddeafe-6724-458a-9486-7528befdfc73 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042253 May 19 15:10:33.528472 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 265/533] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:10:33 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:33.999189 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3bc1a24d-c169-4eae-9a7f-7e230342e5bc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:33.999918 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3bc1a24d-c169-4eae-9a7f-7e230342e5bc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:34.006091 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3bc1a24d-c169-4eae-9a7f-7e230342e5bc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:34.006568 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3bc1a24d-c169-4eae-9a7f-7e230342e5bc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:34.007380 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3bc1a24d-c169-4eae-9a7f-7e230342e5bc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:34.007822 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3bc1a24d-c169-4eae-9a7f-7e230342e5bc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:34.133751 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3bc1a24d-c169-4eae-9a7f-7e230342e5bc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:34.141377 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3bc1a24d-c169-4eae-9a7f-7e230342e5bc tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.147008 May 19 15:10:34.141946 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 269/534] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:33 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:34.453821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1439629490", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-889694620", "security_groups": [{"name": "tempest-secgroup-smoke-387898223"}], "networks": [{"uuid": "06b3cf68-e062-43e2-bf1d-14e41af70353"}], "block_device_mapping_v2": [{"uuid": "8e3573c3-8742-48ee-900b-c62526a8d1c3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:34.539213 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-22d0028a-f12f-48de-9125-cac3034ff101 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:34.540303 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-22d0028a-f12f-48de-9125-cac3034ff101 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:34.546291 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-22d0028a-f12f-48de-9125-cac3034ff101 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:34.546826 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-22d0028a-f12f-48de-9125-cac3034ff101 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:34.547711 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-22d0028a-f12f-48de-9125-cac3034ff101 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:34.548229 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-22d0028a-f12f-48de-9125-cac3034ff101 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:34.565935 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.network.neutron [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] validate_networks() for [('06b3cf68-e062-43e2-bf1d-14e41af70353', None, None, None, None, None)] {{(pid=117445) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:10:34.577818 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-22d0028a-f12f-48de-9125-cac3034ff101 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042528 May 19 15:10:34.578310 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 270/535] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:10:34 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:10:35.144737 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Flavor limits 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:10:35.145171 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Image limits 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:10:35.145655 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Flavor pref 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:10:35.146072 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Image pref 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:10:35.146486 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:10:35.155674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:35.156130 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:35.156941 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:35.157384 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:35.158609 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-43fdad77-fc03-4dcc-8460-d1945caf5d43 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:35.159248 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-43fdad77-fc03-4dcc-8460-d1945caf5d43 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:35.166166 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-43fdad77-fc03-4dcc-8460-d1945caf5d43 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:35.166632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-43fdad77-fc03-4dcc-8460-d1945caf5d43 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:35.167434 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-43fdad77-fc03-4dcc-8460-d1945caf5d43 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:35.167879 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-43fdad77-fc03-4dcc-8460-d1945caf5d43 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:35.174675 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Getting quotas for project ee9ba7310e7e4d558dba77f08668b77b. Resources: {'cores', 'instances', 'ram'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:10:35.179265 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Getting quotas for user 48e29cb55f7d4acabfc451e996b07791 and project ee9ba7310e7e4d558dba77f08668b77b. Resources: {'cores', 'instances', 'ram'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:10:35.239293 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Going to run 1 instances... {{(pid=117445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:10:35.242029 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8e3573c3-8742-48ee-900b-c62526a8d1c3',volume_size=None,volume_type=None)] {{(pid=117445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:10:35.302572 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-43fdad77-fc03-4dcc-8460-d1945caf5d43 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:35.310744 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-43fdad77-fc03-4dcc-8460-d1945caf5d43 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.155932 May 19 15:10:35.311554 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 271/536] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:35 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:10:35.376832 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-28d7f2ff-13b9-41ba-bf2e-86334d2995b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.926676 May 19 15:10:35.377406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 266/537] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:10:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:10:35.442264 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-35c38103-71fb-467a-b3b2-46f24a5cbe84 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:35.442875 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-35c38103-71fb-467a-b3b2-46f24a5cbe84 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:35.496449 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-35c38103-71fb-467a-b3b2-46f24a5cbe84 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:35.503298 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-35c38103-71fb-467a-b3b2-46f24a5cbe84 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1088 microversion: 2.1 time: 0.064832 May 19 15:10:35.503848 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 272/538] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:35 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:35.590268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-08c7651e-06fa-4a94-b07a-237ea4ac8438 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:35.592036 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-08c7651e-06fa-4a94-b07a-237ea4ac8438 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:35.599399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-08c7651e-06fa-4a94-b07a-237ea4ac8438 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:35.599833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-08c7651e-06fa-4a94-b07a-237ea4ac8438 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:35.601254 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-08c7651e-06fa-4a94-b07a-237ea4ac8438 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:35.601646 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-08c7651e-06fa-4a94-b07a-237ea4ac8438 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:35.631047 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-08c7651e-06fa-4a94-b07a-237ea4ac8438 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045168 May 19 15:10:35.631578 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 267/539] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:10:35 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:36.328331 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-df04a61e-244e-4420-82da-a36518314d20 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:36.329623 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-df04a61e-244e-4420-82da-a36518314d20 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:36.336381 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-df04a61e-244e-4420-82da-a36518314d20 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:36.337131 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-df04a61e-244e-4420-82da-a36518314d20 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:36.338303 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-df04a61e-244e-4420-82da-a36518314d20 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:36.338912 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-df04a61e-244e-4420-82da-a36518314d20 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:36.482694 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-df04a61e-244e-4420-82da-a36518314d20 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:36.490081 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-df04a61e-244e-4420-82da-a36518314d20 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1521 microversion: 2.1 time: 0.166622 May 19 15:10:36.500458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 273/540] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:36 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:36.526620 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-83fd0228-c131-4624-92d4-f0183ef07224 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:36.527435 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-83fd0228-c131-4624-92d4-f0183ef07224 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:36.533571 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-83fd0228-c131-4624-92d4-f0183ef07224 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:36.534111 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-83fd0228-c131-4624-92d4-f0183ef07224 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:36.534989 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-83fd0228-c131-4624-92d4-f0183ef07224 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:36.535536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-83fd0228-c131-4624-92d4-f0183ef07224 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:36.596711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-83fd0228-c131-4624-92d4-f0183ef07224 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:36.604888 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-83fd0228-c131-4624-92d4-f0183ef07224 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1186 microversion: 2.1 time: 0.087574 May 19 15:10:36.605541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 268/541] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:36 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:10:36.642725 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-92311c1d-9543-4f17-ad05-f9672166d014 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:36.644040 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-92311c1d-9543-4f17-ad05-f9672166d014 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:36.656216 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-92311c1d-9543-4f17-ad05-f9672166d014 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:36.656676 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-92311c1d-9543-4f17-ad05-f9672166d014 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:36.658224 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-92311c1d-9543-4f17-ad05-f9672166d014 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:36.658823 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-92311c1d-9543-4f17-ad05-f9672166d014 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:36.694514 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-92311c1d-9543-4f17-ad05-f9672166d014 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055766 May 19 15:10:36.695463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 274/542] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:10:36 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 15:10:36.776955 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-edb5ee43-b5e2-4bc8-9e74-f0b4d0a07ffb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:36.778303 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-edb5ee43-b5e2-4bc8-9e74-f0b4d0a07ffb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:36.788520 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-edb5ee43-b5e2-4bc8-9e74-f0b4d0a07ffb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:36.789192 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-edb5ee43-b5e2-4bc8-9e74-f0b4d0a07ffb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:36.790228 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-edb5ee43-b5e2-4bc8-9e74-f0b4d0a07ffb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:36.790890 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-edb5ee43-b5e2-4bc8-9e74-f0b4d0a07ffb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:36.795580 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-92589b74-74cf-4295-b930-c85ef076a8a4 req-1f0a7ea8-673b-45a9-877b-0201ecb87b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1724bc45-95a0-405b-ac06-8e4ffe410b21", "name": "network-vif-deleted", "tag": "58f5d4b7-8286-4eb3-93b6-351b6f5288ae"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:36.811841 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-92589b74-74cf-4295-b930-c85ef076a8a4 req-1f0a7ea8-673b-45a9-877b-0201ecb87b71 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:36.812380 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-92589b74-74cf-4295-b930-c85ef076a8a4 req-1f0a7ea8-673b-45a9-877b-0201ecb87b71 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:36.828606 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-92589b74-74cf-4295-b930-c85ef076a8a4 req-1f0a7ea8-673b-45a9-877b-0201ecb87b71 service nova] Creating event network-vif-deleted:58f5d4b7-8286-4eb3-93b6-351b6f5288ae for instance 1724bc45-95a0-405b-ac06-8e4ffe410b21 on hv-cinder-82549 May 19 15:10:36.833731 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-92589b74-74cf-4295-b930-c85ef076a8a4 req-1f0a7ea8-673b-45a9-877b-0201ecb87b71 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047141 May 19 15:10:36.835662 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 275/543] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:36.843458 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-edb5ee43-b5e2-4bc8-9e74-f0b4d0a07ffb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Going to try to terminate instance {{(pid=117445) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:10:36.915816 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:36.966423 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-edb5ee43-b5e2-4bc8-9e74-f0b4d0a07ffb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 204 len: 0 microversion: 2.1 time: 0.194976 May 19 15:10:36.967565 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 269/544] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:10:36 2022] DELETE /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:10:36.978104 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f802c245-c3b5-4c5a-871b-6f33d4657579 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:36.978982 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f802c245-c3b5-4c5a-871b-6f33d4657579 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:36.985619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f802c245-c3b5-4c5a-871b-6f33d4657579 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:36.986173 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f802c245-c3b5-4c5a-871b-6f33d4657579 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:36.987019 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f802c245-c3b5-4c5a-871b-6f33d4657579 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:36.987545 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f802c245-c3b5-4c5a-871b-6f33d4657579 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:37.119237 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f802c245-c3b5-4c5a-871b-6f33d4657579 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:37.129040 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f802c245-c3b5-4c5a-871b-6f33d4657579 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1680 microversion: 2.1 time: 0.156163 May 19 15:10:37.129810 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 276/545] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:36 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:10:37.508585 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9b991fbf-1dff-4601-bd08-923c0bba37bb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:37.509281 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-9b991fbf-1dff-4601-bd08-923c0bba37bb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:37.515223 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9b991fbf-1dff-4601-bd08-923c0bba37bb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:37.515684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9b991fbf-1dff-4601-bd08-923c0bba37bb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:37.516437 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9b991fbf-1dff-4601-bd08-923c0bba37bb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:37.516870 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9b991fbf-1dff-4601-bd08-923c0bba37bb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:37.547546 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9b991fbf-1dff-4601-bd08-923c0bba37bb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:37.548003 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9b991fbf-1dff-4601-bd08-923c0bba37bb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:37.548453 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-9b991fbf-1dff-4601-bd08-923c0bba37bb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lazy-loading 'fault' on Instance uuid 1724bc45-95a0-405b-ac06-8e4ffe410b21 {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:10:37.594129 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9b991fbf-1dff-4601-bd08-923c0bba37bb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:37.604342 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9b991fbf-1dff-4601-bd08-923c0bba37bb tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1312 microversion: 2.1 time: 0.099559 May 19 15:10:37.605374 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 270/546] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:37 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:37.622790 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-031cb447-8cde-47e0-b217-65723a76a3bb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:37.623438 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-031cb447-8cde-47e0-b217-65723a76a3bb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:37.630086 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-031cb447-8cde-47e0-b217-65723a76a3bb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:37.630734 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-031cb447-8cde-47e0-b217-65723a76a3bb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:37.631836 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-031cb447-8cde-47e0-b217-65723a76a3bb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:37.632279 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-031cb447-8cde-47e0-b217-65723a76a3bb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:37.692953 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-031cb447-8cde-47e0-b217-65723a76a3bb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:37.700526 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-031cb447-8cde-47e0-b217-65723a76a3bb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1204 microversion: 2.1 time: 0.081980 May 19 15:10:37.701092 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 277/547] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:37 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1204 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:38.147959 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4f27b557-1ee4-4248-a24b-744f556d9f64 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:38.148641 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4f27b557-1ee4-4248-a24b-744f556d9f64 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:38.154630 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f27b557-1ee4-4248-a24b-744f556d9f64 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:38.155088 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f27b557-1ee4-4248-a24b-744f556d9f64 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:38.155883 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f27b557-1ee4-4248-a24b-744f556d9f64 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:38.156327 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f27b557-1ee4-4248-a24b-744f556d9f64 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:38.281729 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4f27b557-1ee4-4248-a24b-744f556d9f64 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:38.289194 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4f27b557-1ee4-4248-a24b-744f556d9f64 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1680 microversion: 2.1 time: 0.145728 May 19 15:10:38.289760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 271/548] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:38 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:38.622299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fa7115fe-187e-48aa-803c-a3113c58e26f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:38.622912 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fa7115fe-187e-48aa-803c-a3113c58e26f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:38.629468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fa7115fe-187e-48aa-803c-a3113c58e26f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:38.629937 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fa7115fe-187e-48aa-803c-a3113c58e26f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:38.630713 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fa7115fe-187e-48aa-803c-a3113c58e26f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:38.631278 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fa7115fe-187e-48aa-803c-a3113c58e26f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:38.663711 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fa7115fe-187e-48aa-803c-a3113c58e26f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:38.664160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fa7115fe-187e-48aa-803c-a3113c58e26f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:38.664604 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-fa7115fe-187e-48aa-803c-a3113c58e26f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lazy-loading 'fault' on Instance uuid 1724bc45-95a0-405b-ac06-8e4ffe410b21 {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:10:38.709850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fa7115fe-187e-48aa-803c-a3113c58e26f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5374c90f38b47fcb611e346f3f2ec69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '199f08479d9541bc936bb4ea80bae96a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:38.713591 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:38.718962 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fa7115fe-187e-48aa-803c-a3113c58e26f tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 200 len: 1312 microversion: 2.1 time: 0.101027 May 19 15:10:38.719134 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-72f97944-6b26-4966-9e58-33e2b86284df tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:38.719658 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 278/549] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:38 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:10:38.719919 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-72f97944-6b26-4966-9e58-33e2b86284df tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:38.730608 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-72f97944-6b26-4966-9e58-33e2b86284df tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:38.731331 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-72f97944-6b26-4966-9e58-33e2b86284df tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:38.732255 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-72f97944-6b26-4966-9e58-33e2b86284df tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:38.732884 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-72f97944-6b26-4966-9e58-33e2b86284df tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:38.805276 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-72f97944-6b26-4966-9e58-33e2b86284df tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:38.813998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-72f97944-6b26-4966-9e58-33e2b86284df tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1204 microversion: 2.1 time: 0.099991 May 19 15:10:38.814563 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 272/550] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:38 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1204 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:10:39.306368 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8e02a8a5-aa2c-4e25-b70e-9209254ff93a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:39.306991 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8e02a8a5-aa2c-4e25-b70e-9209254ff93a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:39.313949 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e02a8a5-aa2c-4e25-b70e-9209254ff93a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:39.316621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e02a8a5-aa2c-4e25-b70e-9209254ff93a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:39.317037 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e02a8a5-aa2c-4e25-b70e-9209254ff93a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:39.317494 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8e02a8a5-aa2c-4e25-b70e-9209254ff93a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:39.449257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8e02a8a5-aa2c-4e25-b70e-9209254ff93a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:39.456762 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8e02a8a5-aa2c-4e25-b70e-9209254ff93a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1680 microversion: 2.1 time: 0.154809 May 19 15:10:39.457330 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 279/551] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:39 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:39.831472 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a9464818-4652-4bee-95f1-9877f43077f5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:39.832671 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a9464818-4652-4bee-95f1-9877f43077f5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:39.840214 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a9464818-4652-4bee-95f1-9877f43077f5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:39.840674 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a9464818-4652-4bee-95f1-9877f43077f5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:39.841620 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a9464818-4652-4bee-95f1-9877f43077f5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:39.842072 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a9464818-4652-4bee-95f1-9877f43077f5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:39.842944 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-79e68a7f-f5cc-4e1d-9e7d-d16064c74b53 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:39.843714 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-79e68a7f-f5cc-4e1d-9e7d-d16064c74b53 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] [instance: 1724bc45-95a0-405b-ac06-8e4ffe410b21] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:39.852660 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-79e68a7f-f5cc-4e1d-9e7d-d16064c74b53 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:39.853231 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-79e68a7f-f5cc-4e1d-9e7d-d16064c74b53 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:39.854090 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-79e68a7f-f5cc-4e1d-9e7d-d16064c74b53 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:39.854607 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-79e68a7f-f5cc-4e1d-9e7d-d16064c74b53 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:39.869673 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-79e68a7f-f5cc-4e1d-9e7d-d16064c74b53 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] HTTP exception thrown: Instance 1724bc45-95a0-405b-ac06-8e4ffe410b21 could not be found. May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-79e68a7f-f5cc-4e1d-9e7d-d16064c74b53 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Request method failure captured: May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 HTTP/1.1 May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihlzDaKprO0909qPKc4F_OazQwwc5_Rbafbmht_l8WXneyGFtInLfgtI9qenFfnQFlXMiKiG_mNerNQSxrT4phnzSvWe7hKeozkgWzbgSMTg6jjqWsZx06axD917IRiSdc6jQEGzZZbBsd1kyhzNheIUk6IECPe14kqEerVf8vh7H9Tk May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 199f08479d9541bc936bb4ea80bae96a May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-632949355 May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:10:39.871611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:10:39.873154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_199f08479d9541bc936bb4ea80bae96a", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/199f08479d9541bc936bb4ea80bae96a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/199f08479d9541bc936bb4ea80bae96a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/199f08479d9541bc936bb4ea80bae96a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:10:39.873154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-ServerRescueNegativeTestJSON-632949355 May 19 15:10:39.873154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 199f08479d9541bc936bb4ea80bae96a May 19 15:10:39.873154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-632949355 May 19 15:10:39.873154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-ServerRescueNegativeTestJSON-632949355-project May 19 15:10:39.873154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:10:39.873154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:10:39.873154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: e5374c90f38b47fcb611e346f3f2ec69 May 19 15:10:39.873154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-ServerRescueNegativeTestJSON-632949355-project May 19 15:10:39.873154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:10:39.873154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 1724bc45-95a0-405b-ac06-8e4ffe410b21 could not be found. May 19 15:10:39.873154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '1724bc45-95a0-405b-ac06-8e4ffe410b21'} May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1724bc45-95a0-405b-ac06-8e4ffe410b21 could not be found. May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:10:39.873996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1724bc45-95a0-405b-ac06-8e4ffe410b21 could not be found. May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1724bc45-95a0-405b-ac06-8e4ffe410b21 could not be found. May 19 15:10:39.875432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:39.876706 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-79e68a7f-f5cc-4e1d-9e7d-d16064c74b53 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] Returning 404 to user: Instance 1724bc45-95a0-405b-ac06-8e4ffe410b21 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:10:39.876706 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-79e68a7f-f5cc-4e1d-9e7d-d16064c74b53 tempest-ServerRescueNegativeTestJSON-632949355 tempest-ServerRescueNegativeTestJSON-632949355-project] 10.222.0.24 "GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21" status: 404 len: 111 microversion: 2.1 time: 0.142117 May 19 15:10:39.877652 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 273/552] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:39 2022] GET /compute/v2.1/servers/1724bc45-95a0-405b-ac06-8e4ffe410b21 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:10:40.014371 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a9464818-4652-4bee-95f1-9877f43077f5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:40.025471 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a9464818-4652-4bee-95f1-9877f43077f5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1259 microversion: 2.1 time: 0.197746 May 19 15:10:40.026052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 280/553] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:39 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:40.576292 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-584cd3a0-401a-4a14-9072-d663c363ba71 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:40.576998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-584cd3a0-401a-4a14-9072-d663c363ba71 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:40.583518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-584cd3a0-401a-4a14-9072-d663c363ba71 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:40.584457 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-584cd3a0-401a-4a14-9072-d663c363ba71 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:40.585379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-584cd3a0-401a-4a14-9072-d663c363ba71 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:40.585912 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-584cd3a0-401a-4a14-9072-d663c363ba71 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:40.647702 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-584cd3a0-401a-4a14-9072-d663c363ba71 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:40.655286 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-584cd3a0-401a-4a14-9072-d663c363ba71 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1612 microversion: 2.1 time: 0.185252 May 19 15:10:40.655862 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 274/554] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:40 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1612 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:41.043037 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-bab2ce2a-8d5b-41d9-8961-8e7d88a8d43d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:41.043760 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bab2ce2a-8d5b-41d9-8961-8e7d88a8d43d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:41.050512 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bab2ce2a-8d5b-41d9-8961-8e7d88a8d43d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:41.051073 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bab2ce2a-8d5b-41d9-8961-8e7d88a8d43d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:41.052091 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bab2ce2a-8d5b-41d9-8961-8e7d88a8d43d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:41.052512 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bab2ce2a-8d5b-41d9-8961-8e7d88a8d43d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:41.092426 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-d9ab4a0c-1e7e-4e5b-b932-04dbc1fac021 req-7fd075c3-7ad9-4fdd-9cde-82b06bc66499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81d166a7-9804-44f0-8e9a-a901a6a29cdc", "tag": "5a44dc9e-4dbb-4932-b730-880e5d1f89e8"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:41.109980 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-d9ab4a0c-1e7e-4e5b-b932-04dbc1fac021 req-7fd075c3-7ad9-4fdd-9cde-82b06bc66499 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:41.111850 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-d9ab4a0c-1e7e-4e5b-b932-04dbc1fac021 req-7fd075c3-7ad9-4fdd-9cde-82b06bc66499 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:41.128511 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-d9ab4a0c-1e7e-4e5b-b932-04dbc1fac021 req-7fd075c3-7ad9-4fdd-9cde-82b06bc66499 service nova] Creating event network-changed:5a44dc9e-4dbb-4932-b730-880e5d1f89e8 for instance 81d166a7-9804-44f0-8e9a-a901a6a29cdc on hv-cinder-82549 May 19 15:10:41.135035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-d9ab4a0c-1e7e-4e5b-b932-04dbc1fac021 req-7fd075c3-7ad9-4fdd-9cde-82b06bc66499 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048999 May 19 15:10:41.136142 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 275/555] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:41.226430 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-bab2ce2a-8d5b-41d9-8961-8e7d88a8d43d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:41.235500 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-bab2ce2a-8d5b-41d9-8961-8e7d88a8d43d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1259 microversion: 2.1 time: 0.196487 May 19 15:10:41.236728 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 281/556] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:41 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:41.678471 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e60442b2-74c4-44aa-81c9-d0a851aa0483 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:41.679174 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e60442b2-74c4-44aa-81c9-d0a851aa0483 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:41.690159 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e60442b2-74c4-44aa-81c9-d0a851aa0483 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:41.700738 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e60442b2-74c4-44aa-81c9-d0a851aa0483 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:41.701865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e60442b2-74c4-44aa-81c9-d0a851aa0483 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:41.702619 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e60442b2-74c4-44aa-81c9-d0a851aa0483 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:41.740043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e60442b2-74c4-44aa-81c9-d0a851aa0483 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:41.741274 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e60442b2-74c4-44aa-81c9-d0a851aa0483 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:41.741901 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-e60442b2-74c4-44aa-81c9-d0a851aa0483 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lazy-loading 'fault' on Instance uuid b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:10:41.796296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e60442b2-74c4-44aa-81c9-d0a851aa0483 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:41.807234 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e60442b2-74c4-44aa-81c9-d0a851aa0483 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 200 len: 1330 microversion: 2.1 time: 0.137714 May 19 15:10:41.816890 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 276/557] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:41 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 1330 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:42.255348 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a785bd97-5811-4693-abd3-f3bd65f1238b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:42.256028 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a785bd97-5811-4693-abd3-f3bd65f1238b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:42.263672 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a785bd97-5811-4693-abd3-f3bd65f1238b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:42.264219 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a785bd97-5811-4693-abd3-f3bd65f1238b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:42.265111 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a785bd97-5811-4693-abd3-f3bd65f1238b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:42.265615 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a785bd97-5811-4693-abd3-f3bd65f1238b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:42.435441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a785bd97-5811-4693-abd3-f3bd65f1238b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:42.444626 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a785bd97-5811-4693-abd3-f3bd65f1238b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1259 microversion: 2.1 time: 0.195072 May 19 15:10:42.445457 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 282/558] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:42 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:42.824947 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d11ffe73-d03d-4067-a729-a975050d5e98 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:42.825482 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-d11ffe73-d03d-4067-a729-a975050d5e98 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:42.832121 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d11ffe73-d03d-4067-a729-a975050d5e98 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:42.832578 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d11ffe73-d03d-4067-a729-a975050d5e98 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:42.833343 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d11ffe73-d03d-4067-a729-a975050d5e98 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:42.833778 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d11ffe73-d03d-4067-a729-a975050d5e98 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:42.847309 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-d11ffe73-d03d-4067-a729-a975050d5e98 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] HTTP exception thrown: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d11ffe73-d03d-4067-a729-a975050d5e98 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Request method failure captured: May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f HTTP/1.1 May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihlzC36TVjbhLtU3g9xMp125AwUSov1duWZll1n5H-S_HScG7MruR7Gs1GViXAQd0SIJut8uotHNInm1_M2FBmXP1RayH0EJZ45YHoedSq6oTnynPABMFxjsri0-n9qTagsLk52YqxiHKDUiWNSXW6fHPq-ckGn5xy8R26VrSRWiq2XI May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:10:42.848950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:10:42.850755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_34c1099557144b8bb2fff88f5b526834", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:10:42.850755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:10:42.850755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:10:42.850755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:10:42.850755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:10:42.850755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:10:42.850755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:10:42.850755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: af7838e525a042dfa0357ad1fc58cf21 May 19 15:10:42.850755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:10:42.850755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:10:42.850755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. May 19 15:10:42.850755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': 'b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f'} May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:10:42.851776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. May 19 15:10:42.852968 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:10:42.854018 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d11ffe73-d03d-4067-a729-a975050d5e98 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Returning 404 to user: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:10:42.854018 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-d11ffe73-d03d-4067-a729-a975050d5e98 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 404 len: 111 microversion: 2.1 time: 0.029876 May 19 15:10:42.854018 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 277/559] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:42 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 15:10:42.859658 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-23d5bb30-6f75-494e-bca1-67c2fdb9b2cb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '.version_select at 0x7f35d1390280>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:42.878000 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-23d5bb30-6f75-494e-bca1-67c2fdb9b2cb tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-337214131" status: 202 len: 0 microversion: 2.1 time: 0.022059 May 19 15:10:42.878682 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 283/560] 10.222.0.24 () {58 vars in 1217 bytes} [Thu May 19 15:10:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-337214131 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:10:43.157728 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-6531ad1b-368c-49ed-ae57-f4bc8cc31129 req-593b6006-4887-4f3e-97d0-a267ddf31cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f", "name": "network-vif-deleted", "tag": "5baf0002-96ad-4905-b2cd-17f13f1918c2"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:43.165843 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-6531ad1b-368c-49ed-ae57-f4bc8cc31129 req-593b6006-4887-4f3e-97d0-a267ddf31cdc service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:43.166393 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-6531ad1b-368c-49ed-ae57-f4bc8cc31129 req-593b6006-4887-4f3e-97d0-a267ddf31cdc service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:43.178648 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-6531ad1b-368c-49ed-ae57-f4bc8cc31129 req-593b6006-4887-4f3e-97d0-a267ddf31cdc service nova] Creating event network-vif-deleted:5baf0002-96ad-4905-b2cd-17f13f1918c2 for instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f on hv-cinder-82549 May 19 15:10:43.184572 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-6531ad1b-368c-49ed-ae57-f4bc8cc31129 req-593b6006-4887-4f3e-97d0-a267ddf31cdc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030522 May 19 15:10:43.185487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 278/561] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:10:43.464448 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-613e2b1b-d957-4e4d-aea0-ea58c6d92553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:43.465889 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-613e2b1b-d957-4e4d-aea0-ea58c6d92553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:43.474341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-613e2b1b-d957-4e4d-aea0-ea58c6d92553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:43.475858 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-613e2b1b-d957-4e4d-aea0-ea58c6d92553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:43.476914 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-613e2b1b-d957-4e4d-aea0-ea58c6d92553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:43.477697 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-613e2b1b-d957-4e4d-aea0-ea58c6d92553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:43.576322 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3c02a97f-0a36-4d27-a07b-c699e33c90e5 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Action: 'create', calling method: .version_select at 0x7f35d1386af0>, body: {"keypair": {"name": "tempest-keypair-729097809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLd81OZILZPldvTYKYWBe5fZ9+o9+BEoA0zMBMBRrHWuShg0M1fILzr5MJjriO6I3UmStdvn+Tbf1MvCPCU7QHPbClds/hWzH1CT3o+8ri7Ux0ypD84e+QH7zEeC6BrNg=="}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:43.596012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-3c02a97f-0a36-4d27-a07b-c699e33c90e5 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for project 34c1099557144b8bb2fff88f5b526834. Resources: {'key_pairs'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:10:43.601095 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-3c02a97f-0a36-4d27-a07b-c699e33c90e5 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for user af7838e525a042dfa0357ad1fc58cf21 and project 34c1099557144b8bb2fff88f5b526834. Resources: {'key_pairs'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:10:43.644060 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-3c02a97f-0a36-4d27-a07b-c699e33c90e5 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.073815 May 19 15:10:43.645076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 279/562] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 15:10:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:43.659350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-613e2b1b-d957-4e4d-aea0-ea58c6d92553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:43.670297 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-613e2b1b-d957-4e4d-aea0-ea58c6d92553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1259 microversion: 2.1 time: 0.212190 May 19 15:10:43.672109 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 284/563] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:43 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1259 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:44.688267 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4f68489c-6b3e-4dc5-b960-3df8ab8713aa tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:44.689002 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4f68489c-6b3e-4dc5-b960-3df8ab8713aa tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:44.697195 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f68489c-6b3e-4dc5-b960-3df8ab8713aa tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:44.697713 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f68489c-6b3e-4dc5-b960-3df8ab8713aa tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:44.698928 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f68489c-6b3e-4dc5-b960-3df8ab8713aa tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:44.705959 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f68489c-6b3e-4dc5-b960-3df8ab8713aa tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:45.137159 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4f68489c-6b3e-4dc5-b960-3df8ab8713aa tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:45.144758 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4f68489c-6b3e-4dc5-b960-3df8ab8713aa tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1259 microversion: 2.1 time: 0.460883 May 19 15:10:45.145342 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 280/564] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:44 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1259 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:45.454774 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1652271842", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c03712e-3615-4599-bcae-117320ca4aeb"}], "security_groups": [{"name": "tempest-securitygroup--1329459472"}], "key_name": "tempest-keypair-729097809", "user_data": "}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:45.500674 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:45.611682 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] validate_networks() for [('6c03712e-3615-4599-bcae-117320ca4aeb', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:10:46.133211 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:10:46.133516 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:10:46.134038 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:10:46.134446 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:10:46.134976 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:10:46.150218 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:46.150668 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:46.151616 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:46.152054 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:46.161704 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-86da8d35-2931-440a-b91c-fff4dfe34980 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:46.163249 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-86da8d35-2931-440a-b91c-fff4dfe34980 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:46.165450 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=2 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:46.171836 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for project 34c1099557144b8bb2fff88f5b526834. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:10:46.174400 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-86da8d35-2931-440a-b91c-fff4dfe34980 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:46.174928 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-86da8d35-2931-440a-b91c-fff4dfe34980 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:46.175824 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-86da8d35-2931-440a-b91c-fff4dfe34980 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:46.176343 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-86da8d35-2931-440a-b91c-fff4dfe34980 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:46.178203 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Getting quotas for user af7838e525a042dfa0357ad1fc58cf21 and project 34c1099557144b8bb2fff88f5b526834. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:10:46.191697 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:10:46.194934 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:10:46.245333 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a39626c9-a88b-49bf-a060-a4d0855475c7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.794592 May 19 15:10:46.247073 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 285/565] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:10:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:10:46.267022 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-552a1787-44ae-4854-8e69-dcd24ed79ce9 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:46.267718 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-552a1787-44ae-4854-8e69-dcd24ed79ce9 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:46.345709 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-552a1787-44ae-4854-8e69-dcd24ed79ce9 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:46.359486 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-552a1787-44ae-4854-8e69-dcd24ed79ce9 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 200 len: 1241 microversion: 2.1 time: 0.105782 May 19 15:10:46.360110 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 286/566] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:46 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:46.380550 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-86da8d35-2931-440a-b91c-fff4dfe34980 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:46.391626 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-86da8d35-2931-440a-b91c-fff4dfe34980 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1259 microversion: 2.1 time: 0.233347 May 19 15:10:46.393215 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 281/567] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:46 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1259 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:10:47.377241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4a0271a7-fe07-443c-a6e0-0c5dc60ab7e9 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:47.377956 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4a0271a7-fe07-443c-a6e0-0c5dc60ab7e9 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:47.384881 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4a0271a7-fe07-443c-a6e0-0c5dc60ab7e9 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:47.385431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4a0271a7-fe07-443c-a6e0-0c5dc60ab7e9 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:47.386277 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4a0271a7-fe07-443c-a6e0-0c5dc60ab7e9 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:47.386791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4a0271a7-fe07-443c-a6e0-0c5dc60ab7e9 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:47.412839 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-2317a3f3-203b-4637-9855-3f18e75c10ab tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:47.415861 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-2317a3f3-203b-4637-9855-3f18e75c10ab tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:47.427052 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2317a3f3-203b-4637-9855-3f18e75c10ab tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:47.428251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2317a3f3-203b-4637-9855-3f18e75c10ab tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:47.429460 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2317a3f3-203b-4637-9855-3f18e75c10ab tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:47.430093 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2317a3f3-203b-4637-9855-3f18e75c10ab tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:47.467941 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4a0271a7-fe07-443c-a6e0-0c5dc60ab7e9 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:47.476935 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4a0271a7-fe07-443c-a6e0-0c5dc60ab7e9 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 200 len: 1299 microversion: 2.1 time: 0.103507 May 19 15:10:47.477539 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 287/568] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:47 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:47.656312 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-2317a3f3-203b-4637-9855-3f18e75c10ab tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:47.669339 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-2317a3f3-203b-4637-9855-3f18e75c10ab tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1259 microversion: 2.1 time: 0.262409 May 19 15:10:47.670083 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 282/569] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:47 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:48.494551 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-81b47f5b-e101-4d6c-8a23-84a892b0f7f8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:48.496100 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-81b47f5b-e101-4d6c-8a23-84a892b0f7f8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:48.524130 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-81b47f5b-e101-4d6c-8a23-84a892b0f7f8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:48.529743 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-81b47f5b-e101-4d6c-8a23-84a892b0f7f8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:48.531362 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-81b47f5b-e101-4d6c-8a23-84a892b0f7f8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:48.532029 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-81b47f5b-e101-4d6c-8a23-84a892b0f7f8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:48.690477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e0ce5d0a-0e06-4592-93f2-74c783c3ea4f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:48.692583 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e0ce5d0a-0e06-4592-93f2-74c783c3ea4f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:48.704150 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e0ce5d0a-0e06-4592-93f2-74c783c3ea4f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:48.704848 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e0ce5d0a-0e06-4592-93f2-74c783c3ea4f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:48.707027 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e0ce5d0a-0e06-4592-93f2-74c783c3ea4f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:48.708202 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e0ce5d0a-0e06-4592-93f2-74c783c3ea4f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:48.711371 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-81b47f5b-e101-4d6c-8a23-84a892b0f7f8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:48.720551 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-81b47f5b-e101-4d6c-8a23-84a892b0f7f8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 200 len: 1367 microversion: 2.1 time: 0.230299 May 19 15:10:48.721581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 288/570] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:48 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:48.896448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e0ce5d0a-0e06-4592-93f2-74c783c3ea4f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:48.907703 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e0ce5d0a-0e06-4592-93f2-74c783c3ea4f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1259 microversion: 2.1 time: 0.225105 May 19 15:10:48.920624 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 283/571] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:48 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:49.740285 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-42b393e4-1c00-40b4-a345-8cb94ee3bde7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:49.742303 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-42b393e4-1c00-40b4-a345-8cb94ee3bde7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:49.750618 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-42b393e4-1c00-40b4-a345-8cb94ee3bde7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:49.751486 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-42b393e4-1c00-40b4-a345-8cb94ee3bde7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:49.753712 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-42b393e4-1c00-40b4-a345-8cb94ee3bde7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:49.754366 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-42b393e4-1c00-40b4-a345-8cb94ee3bde7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:49.928081 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-44f86f07-12e3-4665-ad02-be9932aa9a02 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:49.929304 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-44f86f07-12e3-4665-ad02-be9932aa9a02 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:49.949943 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-44f86f07-12e3-4665-ad02-be9932aa9a02 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:49.951490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-44f86f07-12e3-4665-ad02-be9932aa9a02 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:49.955427 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-42b393e4-1c00-40b4-a345-8cb94ee3bde7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:49.975450 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-44f86f07-12e3-4665-ad02-be9932aa9a02 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:49.976298 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-44f86f07-12e3-4665-ad02-be9932aa9a02 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:49.978057 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-42b393e4-1c00-40b4-a345-8cb94ee3bde7 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 200 len: 1367 microversion: 2.1 time: 0.236688 May 19 15:10:49.978700 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 289/572] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:49 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:50.168065 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-44f86f07-12e3-4665-ad02-be9932aa9a02 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:50.178491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-44f86f07-12e3-4665-ad02-be9932aa9a02 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1259 microversion: 2.1 time: 0.256318 May 19 15:10:50.181019 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 284/573] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:49 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1259 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:10:50.328979 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-611f8a5a-9398-4b0b-85bb-ff1dac89de73 req-0a3b3d40-b349-43b2-b368-c179bcbb3ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a263534-d906-4c7d-9b25-88e0aca68b0c", "tag": "755d6177-6434-4526-90a2-6d811cc92c76"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:50.342484 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-611f8a5a-9398-4b0b-85bb-ff1dac89de73 req-0a3b3d40-b349-43b2-b368-c179bcbb3ba1 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:50.343260 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-611f8a5a-9398-4b0b-85bb-ff1dac89de73 req-0a3b3d40-b349-43b2-b368-c179bcbb3ba1 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:50.363848 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-611f8a5a-9398-4b0b-85bb-ff1dac89de73 req-0a3b3d40-b349-43b2-b368-c179bcbb3ba1 service nova] Creating event network-changed:755d6177-6434-4526-90a2-6d811cc92c76 for instance 1a263534-d906-4c7d-9b25-88e0aca68b0c on hv-cinder-82549 May 19 15:10:50.370419 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-611f8a5a-9398-4b0b-85bb-ff1dac89de73 req-0a3b3d40-b349-43b2-b368-c179bcbb3ba1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230155 May 19 15:10:50.371888 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 290/574] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:10:50.996071 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-de5852fc-2ae8-4d55-a0ce-503e50c2ea1a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:50.997372 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-de5852fc-2ae8-4d55-a0ce-503e50c2ea1a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:51.004133 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-de5852fc-2ae8-4d55-a0ce-503e50c2ea1a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:51.004516 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-de5852fc-2ae8-4d55-a0ce-503e50c2ea1a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:51.005298 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-de5852fc-2ae8-4d55-a0ce-503e50c2ea1a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:51.005796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-de5852fc-2ae8-4d55-a0ce-503e50c2ea1a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:51.203562 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ba922f35-c72f-49f5-af02-e2ca6391edbb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:51.205281 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ba922f35-c72f-49f5-af02-e2ca6391edbb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:51.215363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ba922f35-c72f-49f5-af02-e2ca6391edbb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:51.216359 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ba922f35-c72f-49f5-af02-e2ca6391edbb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:51.217439 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ba922f35-c72f-49f5-af02-e2ca6391edbb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:51.218072 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ba922f35-c72f-49f5-af02-e2ca6391edbb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:51.241759 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-de5852fc-2ae8-4d55-a0ce-503e50c2ea1a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:51.253592 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-de5852fc-2ae8-4d55-a0ce-503e50c2ea1a tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 200 len: 1367 microversion: 2.1 time: 0.261757 May 19 15:10:51.259675 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 285/575] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:50 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:51.314180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-8c4e78f2-21ee-4467-b7ea-ed21735ee9bb req-f8eb4681-977e-4113-b571-260c0ec30686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d166a7-9804-44f0-8e9a-a901a6a29cdc", "name": "network-vif-plugged", "status": "completed", "tag": "5a44dc9e-4dbb-4932-b730-880e5d1f89e8"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:51.326084 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:51.328904 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-8c4e78f2-21ee-4467-b7ea-ed21735ee9bb req-f8eb4681-977e-4113-b571-260c0ec30686 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:51.335820 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-8c4e78f2-21ee-4467-b7ea-ed21735ee9bb req-f8eb4681-977e-4113-b571-260c0ec30686 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:51.357500 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-8c4e78f2-21ee-4467-b7ea-ed21735ee9bb req-f8eb4681-977e-4113-b571-260c0ec30686 service nova] Creating event network-vif-plugged:5a44dc9e-4dbb-4932-b730-880e5d1f89e8 for instance 81d166a7-9804-44f0-8e9a-a901a6a29cdc on hv-cinder-82549 May 19 15:10:51.393064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-8c4e78f2-21ee-4467-b7ea-ed21735ee9bb req-f8eb4681-977e-4113-b571-260c0ec30686 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065830 May 19 15:10:51.395297 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 286/576] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:51.501344 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ba922f35-c72f-49f5-af02-e2ca6391edbb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:51.514973 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ba922f35-c72f-49f5-af02-e2ca6391edbb tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1259 microversion: 2.1 time: 0.319914 May 19 15:10:51.525161 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 291/577] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:51 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1259 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:52.275342 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3c1f774f-9447-4d03-b146-56b9d9714229 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:52.276052 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-3c1f774f-9447-4d03-b146-56b9d9714229 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:52.289913 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3c1f774f-9447-4d03-b146-56b9d9714229 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:52.291492 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3c1f774f-9447-4d03-b146-56b9d9714229 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:52.292444 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3c1f774f-9447-4d03-b146-56b9d9714229 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:52.293041 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3c1f774f-9447-4d03-b146-56b9d9714229 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:52.520600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-3c1f774f-9447-4d03-b146-56b9d9714229 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:52.532826 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-74528724-830f-46ed-94e3-3b07f7dc6eb2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:52.533455 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-74528724-830f-46ed-94e3-3b07f7dc6eb2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:52.539396 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-3c1f774f-9447-4d03-b146-56b9d9714229 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 200 len: 1367 microversion: 2.1 time: 0.269994 May 19 15:10:52.540739 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-74528724-830f-46ed-94e3-3b07f7dc6eb2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:52.541376 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-74528724-830f-46ed-94e3-3b07f7dc6eb2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:52.542348 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-74528724-830f-46ed-94e3-3b07f7dc6eb2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:52.542956 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-74528724-830f-46ed-94e3-3b07f7dc6eb2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:52.549973 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 287/578] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:52 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:52.770597 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-74528724-830f-46ed-94e3-3b07f7dc6eb2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:52.780734 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-74528724-830f-46ed-94e3-3b07f7dc6eb2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1259 microversion: 2.1 time: 0.251482 May 19 15:10:52.782078 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 292/579] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:52 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1259 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:10:53.231361 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e401fe9d-c49a-4d86-ba25-a448dc70b562 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Action: 'create', calling method: .version_select at 0x7f35d149e4c0>, body: {"keypair": {"name": "tempest-keypair-1866684903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB5BaoB/MgnE9kb2NLGpNj+IQ5bURa6GzZhJdWo3xolVvNXlR1fmjloc9S5oYOJRMhqzgvkiZv1ybpiom6E0D4a7i2e6jjEJcOOunYVGpKfOmMxIBqNLOFOtsUxYUkWqQ=="}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:53.248900 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-e401fe9d-c49a-4d86-ba25-a448dc70b562 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Getting quotas for project 5b1521fd041a446e851d82487479930b. Resources: {'key_pairs'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:10:53.254183 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-e401fe9d-c49a-4d86-ba25-a448dc70b562 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Getting quotas for user 0022fc1107834a5cbe30f0146361213b and project 5b1521fd041a446e851d82487479930b. Resources: {'key_pairs'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:10:53.281460 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e401fe9d-c49a-4d86-ba25-a448dc70b562 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104465 May 19 15:10:53.283318 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 288/580] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 15:10:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:53.556860 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-85fe2e9b-4d50-4904-9efb-fd3b00fa9557 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:53.557507 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-85fe2e9b-4d50-4904-9efb-fd3b00fa9557 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:53.564764 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85fe2e9b-4d50-4904-9efb-fd3b00fa9557 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:53.565154 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85fe2e9b-4d50-4904-9efb-fd3b00fa9557 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:53.565949 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85fe2e9b-4d50-4904-9efb-fd3b00fa9557 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:53.566418 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-85fe2e9b-4d50-4904-9efb-fd3b00fa9557 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:53.798937 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7acc1dca-3d28-4037-a4db-d390e938365a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:53.799689 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-85fe2e9b-4d50-4904-9efb-fd3b00fa9557 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:53.799873 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7acc1dca-3d28-4037-a4db-d390e938365a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:53.807988 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7acc1dca-3d28-4037-a4db-d390e938365a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:53.808755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7acc1dca-3d28-4037-a4db-d390e938365a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:53.809723 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7acc1dca-3d28-4037-a4db-d390e938365a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:53.810489 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7acc1dca-3d28-4037-a4db-d390e938365a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:53.811586 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-85fe2e9b-4d50-4904-9efb-fd3b00fa9557 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 200 len: 1367 microversion: 2.1 time: 0.257107 May 19 15:10:53.813170 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 293/581] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:53 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:53.993847 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7acc1dca-3d28-4037-a4db-d390e938365a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:54.005154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7acc1dca-3d28-4037-a4db-d390e938365a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1444 microversion: 2.1 time: 0.210500 May 19 15:10:54.006277 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 289/582] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:53 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1444 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:54.022652 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6a063efa-0f1b-4a5d-a178-3453fb0d3c1f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:54.023294 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6a063efa-0f1b-4a5d-a178-3453fb0d3c1f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:54.029416 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6a063efa-0f1b-4a5d-a178-3453fb0d3c1f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:54.029959 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6a063efa-0f1b-4a5d-a178-3453fb0d3c1f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:54.030823 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6a063efa-0f1b-4a5d-a178-3453fb0d3c1f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:54.031602 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6a063efa-0f1b-4a5d-a178-3453fb0d3c1f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:54.169611 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6a063efa-0f1b-4a5d-a178-3453fb0d3c1f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:54.177619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6a063efa-0f1b-4a5d-a178-3453fb0d3c1f tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1444 microversion: 2.1 time: 0.158870 May 19 15:10:54.178425 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 294/583] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:54 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:54.831658 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4326d7af-0104-4b12-a192-8d945481b338 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:54.833604 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4326d7af-0104-4b12-a192-8d945481b338 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:54.841139 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4326d7af-0104-4b12-a192-8d945481b338 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:54.841918 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4326d7af-0104-4b12-a192-8d945481b338 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:54.842909 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4326d7af-0104-4b12-a192-8d945481b338 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:54.844446 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4326d7af-0104-4b12-a192-8d945481b338 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:54.869056 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1240174122", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "213b532b-8cec-4733-b487-2a170eb06a7a"}], "security_groups": [{"name": "tempest-securitygroup--1149503794"}], "key_name": "tempest-keypair-1866684903", "user_data": "}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:55.360668 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] validate_networks() for [('213b532b-8cec-4733-b487-2a170eb06a7a', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:10:55.366332 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4326d7af-0104-4b12-a192-8d945481b338 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:55.374126 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4326d7af-0104-4b12-a192-8d945481b338 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 200 len: 1367 microversion: 2.1 time: 0.548042 May 19 15:10:55.374708 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 290/584] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:54 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 1367 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:55.891470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-9129780e-e4e4-4df6-9563-82b1dc7434ff req-7a5e61fe-0c7b-4ed5-a8d6-72aab51b7b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a263534-d906-4c7d-9b25-88e0aca68b0c", "name": "network-vif-plugged", "status": "completed", "tag": "755d6177-6434-4526-90a2-6d811cc92c76"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:55.916681 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-9129780e-e4e4-4df6-9563-82b1dc7434ff req-7a5e61fe-0c7b-4ed5-a8d6-72aab51b7b69 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:55.917143 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-9129780e-e4e4-4df6-9563-82b1dc7434ff req-7a5e61fe-0c7b-4ed5-a8d6-72aab51b7b69 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:55.930410 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=100 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:55.948463 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-9129780e-e4e4-4df6-9563-82b1dc7434ff req-7a5e61fe-0c7b-4ed5-a8d6-72aab51b7b69 service nova] Creating event network-vif-plugged:755d6177-6434-4526-90a2-6d811cc92c76 for instance 1a263534-d906-4c7d-9b25-88e0aca68b0c on hv-cinder-82549 May 19 15:10:55.954590 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-9129780e-e4e4-4df6-9563-82b1dc7434ff req-7a5e61fe-0c7b-4ed5-a8d6-72aab51b7b69 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066684 May 19 15:10:55.956547 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 291/585] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:56.100589 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:10:56.101595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:10:56.102457 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:10:56.103024 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:10:56.103622 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:10:56.107337 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:56.119034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:56.120051 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:56.121022 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:56.121624 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:56.149039 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Getting quotas for project 5b1521fd041a446e851d82487479930b. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:10:56.155218 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Getting quotas for user 0022fc1107834a5cbe30f0146361213b and project 5b1521fd041a446e851d82487479930b. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:10:56.169479 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:10:56.171992 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:10:56.233483 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-bb9c949e-8da6-44f3-8c03-8f1417f3c45b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.370311 May 19 15:10:56.234146 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 295/586] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:10:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:10:56.246036 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-051a33b6-e605-4560-aa38-a976e9891405 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:56.246948 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-051a33b6-e605-4560-aa38-a976e9891405 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:56.341081 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-051a33b6-e605-4560-aa38-a976e9891405 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:56.350465 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-051a33b6-e605-4560-aa38-a976e9891405 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1238 microversion: 2.1 time: 0.109927 May 19 15:10:56.360608 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 292/587] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:56 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1238 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:56.391816 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5663d6d4-86b4-46d2-986a-00469e675351 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:56.392445 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5663d6d4-86b4-46d2-986a-00469e675351 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:56.401219 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5663d6d4-86b4-46d2-986a-00469e675351 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:56.401681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5663d6d4-86b4-46d2-986a-00469e675351 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:56.402645 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5663d6d4-86b4-46d2-986a-00469e675351 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:56.403888 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5663d6d4-86b4-46d2-986a-00469e675351 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:56.655311 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5663d6d4-86b4-46d2-986a-00469e675351 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:56.665919 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5663d6d4-86b4-46d2-986a-00469e675351 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 200 len: 1367 microversion: 2.1 time: 0.278627 May 19 15:10:56.666660 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 296/588] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:56 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:56.990647 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-5948a847-6905-4992-b96a-ffe0fd8bef71 req-cf485d81-e2c7-48b1-88b0-ed78b8baa07d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81d166a7-9804-44f0-8e9a-a901a6a29cdc", "tag": "5a44dc9e-4dbb-4932-b730-880e5d1f89e8"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:56.999971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-5948a847-6905-4992-b96a-ffe0fd8bef71 req-cf485d81-e2c7-48b1-88b0-ed78b8baa07d service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:57.000516 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-5948a847-6905-4992-b96a-ffe0fd8bef71 req-cf485d81-e2c7-48b1-88b0-ed78b8baa07d service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:57.012504 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-5948a847-6905-4992-b96a-ffe0fd8bef71 req-cf485d81-e2c7-48b1-88b0-ed78b8baa07d service nova] Creating event network-changed:5a44dc9e-4dbb-4932-b730-880e5d1f89e8 for instance 81d166a7-9804-44f0-8e9a-a901a6a29cdc on hv-cinder-82549 May 19 15:10:57.017560 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-5948a847-6905-4992-b96a-ffe0fd8bef71 req-cf485d81-e2c7-48b1-88b0-ed78b8baa07d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031566 May 19 15:10:57.018228 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 293/589] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:10:57.367721 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-68387843-9d53-4a8d-af8f-56c8691dc7db tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:57.369197 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-68387843-9d53-4a8d-af8f-56c8691dc7db tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:57.375907 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-68387843-9d53-4a8d-af8f-56c8691dc7db tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:57.376359 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-68387843-9d53-4a8d-af8f-56c8691dc7db tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:57.377127 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-68387843-9d53-4a8d-af8f-56c8691dc7db tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:57.377564 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-68387843-9d53-4a8d-af8f-56c8691dc7db tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:57.443631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-68387843-9d53-4a8d-af8f-56c8691dc7db tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:57.453829 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-68387843-9d53-4a8d-af8f-56c8691dc7db tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1290 microversion: 2.1 time: 0.089967 May 19 15:10:57.454396 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 297/590] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:57 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:57.686621 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4087007f-f63f-42c1-b3b2-c29b19ea4ae8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:57.687615 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4087007f-f63f-42c1-b3b2-c29b19ea4ae8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:57.694751 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4087007f-f63f-42c1-b3b2-c29b19ea4ae8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:57.695316 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4087007f-f63f-42c1-b3b2-c29b19ea4ae8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:57.696164 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4087007f-f63f-42c1-b3b2-c29b19ea4ae8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:57.696710 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4087007f-f63f-42c1-b3b2-c29b19ea4ae8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:57.833969 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4087007f-f63f-42c1-b3b2-c29b19ea4ae8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:57.841422 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4087007f-f63f-42c1-b3b2-c29b19ea4ae8 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 200 len: 1367 microversion: 2.1 time: 0.160948 May 19 15:10:57.844015 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 294/591] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:57 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:10:58.472861 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-053ae52d-b2db-46ce-8837-2b6c2962fd3f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:58.473507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-053ae52d-b2db-46ce-8837-2b6c2962fd3f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:58.481233 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-053ae52d-b2db-46ce-8837-2b6c2962fd3f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:58.481702 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-053ae52d-b2db-46ce-8837-2b6c2962fd3f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:58.482846 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-053ae52d-b2db-46ce-8837-2b6c2962fd3f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:58.483227 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-053ae52d-b2db-46ce-8837-2b6c2962fd3f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:58.552891 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-053ae52d-b2db-46ce-8837-2b6c2962fd3f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:58.561525 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-053ae52d-b2db-46ce-8837-2b6c2962fd3f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1296 microversion: 2.1 time: 0.094367 May 19 15:10:58.562252 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 295/592] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:58 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:10:58.582285 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-12a537f7-aab3-47e9-a811-4d3d5d6db31b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:58.582795 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-12a537f7-aab3-47e9-a811-4d3d5d6db31b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:58.588824 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12a537f7-aab3-47e9-a811-4d3d5d6db31b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:58.589283 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12a537f7-aab3-47e9-a811-4d3d5d6db31b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:58.590048 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12a537f7-aab3-47e9-a811-4d3d5d6db31b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:58.590491 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-12a537f7-aab3-47e9-a811-4d3d5d6db31b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:58.613629 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-12a537f7-aab3-47e9-a811-4d3d5d6db31b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f/ips" status: 200 len: 150 microversion: 2.20 time: 0.160825 May 19 15:10:58.614190 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 298/593] 10.222.0.24 () {60 vars in 1288 bytes} [Thu May 19 15:10:58 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f/ips => generated 150 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 15:10:58.862072 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7e32e339-2bf0-4d7a-b78f-3a6ed7323514 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:58.862760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7e32e339-2bf0-4d7a-b78f-3a6ed7323514 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:58.871986 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7e32e339-2bf0-4d7a-b78f-3a6ed7323514 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:58.872581 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7e32e339-2bf0-4d7a-b78f-3a6ed7323514 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:58.873421 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7e32e339-2bf0-4d7a-b78f-3a6ed7323514 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:58.874441 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7e32e339-2bf0-4d7a-b78f-3a6ed7323514 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:59.023240 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7e32e339-2bf0-4d7a-b78f-3a6ed7323514 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:10:59.031316 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7e32e339-2bf0-4d7a-b78f-3a6ed7323514 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 200 len: 1556 microversion: 2.1 time: 0.175179 May 19 15:10:59.032476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 296/594] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:58 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:10:59.048591 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4661a296-adb7-4e25-8077-22a175d4af36 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:59.049329 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4661a296-adb7-4e25-8077-22a175d4af36 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:59.056022 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4661a296-adb7-4e25-8077-22a175d4af36 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:59.056478 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4661a296-adb7-4e25-8077-22a175d4af36 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:59.057251 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4661a296-adb7-4e25-8077-22a175d4af36 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:59.057691 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4661a296-adb7-4e25-8077-22a175d4af36 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:59.146905 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4661a296-adb7-4e25-8077-22a175d4af36 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102480 May 19 15:10:59.147537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 299/595] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 15:10:59 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:10:59.578070 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7e9ba3b9-119e-49ce-900e-801902f02cbb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:10:59.578777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7e9ba3b9-119e-49ce-900e-801902f02cbb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:10:59.586008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7e9ba3b9-119e-49ce-900e-801902f02cbb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:59.586531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7e9ba3b9-119e-49ce-900e-801902f02cbb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:59.587455 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7e9ba3b9-119e-49ce-900e-801902f02cbb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:59.587995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7e9ba3b9-119e-49ce-900e-801902f02cbb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:59.871224 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-320ec944-b75f-4f4b-bd28-0253358b857c req-fe65f4d4-4fe0-4707-b0ed-8dd4cf607018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20c74e3-1f32-4118-b98b-2e60725d9ea2", "tag": "ccdc4c36-ce1d-470e-9208-6ea0c0ff6e38"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:10:59.879704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-320ec944-b75f-4f4b-bd28-0253358b857c req-fe65f4d4-4fe0-4707-b0ed-8dd4cf607018 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:10:59.880944 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-320ec944-b75f-4f4b-bd28-0253358b857c req-fe65f4d4-4fe0-4707-b0ed-8dd4cf607018 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:10:59.898400 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=100 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:10:59.918419 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-320ec944-b75f-4f4b-bd28-0253358b857c req-fe65f4d4-4fe0-4707-b0ed-8dd4cf607018 service nova] Creating event network-changed:ccdc4c36-ce1d-470e-9208-6ea0c0ff6e38 for instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 on hv-cinder-82549 May 19 15:10:59.935564 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-320ec944-b75f-4f4b-bd28-0253358b857c req-fe65f4d4-4fe0-4707-b0ed-8dd4cf607018 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064867 May 19 15:10:59.937165 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 300/596] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:11:00.075310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7e9ba3b9-119e-49ce-900e-801902f02cbb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:00.088761 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7e9ba3b9-119e-49ce-900e-801902f02cbb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1364 microversion: 2.1 time: 0.514445 May 19 15:11:00.090041 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 297/597] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:10:59 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1364 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:00.436422 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-82e25fe8-9a68-444d-b5e4-28e389b9b052 req-b210a9b1-d937-485d-a669-78fb44584d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a263534-d906-4c7d-9b25-88e0aca68b0c", "tag": "755d6177-6434-4526-90a2-6d811cc92c76"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:00.445527 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-82e25fe8-9a68-444d-b5e4-28e389b9b052 req-b210a9b1-d937-485d-a669-78fb44584d46 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:00.446043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-82e25fe8-9a68-444d-b5e4-28e389b9b052 req-b210a9b1-d937-485d-a669-78fb44584d46 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:00.447348 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3117147f-5b0c-41e5-84af-135d34922ac9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:00.447704 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-3117147f-5b0c-41e5-84af-135d34922ac9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:00.453751 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3117147f-5b0c-41e5-84af-135d34922ac9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:00.454607 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3117147f-5b0c-41e5-84af-135d34922ac9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:00.455307 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3117147f-5b0c-41e5-84af-135d34922ac9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:00.455850 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3117147f-5b0c-41e5-84af-135d34922ac9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:00.457670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-82e25fe8-9a68-444d-b5e4-28e389b9b052 req-b210a9b1-d937-485d-a669-78fb44584d46 service nova] Creating event network-changed:755d6177-6434-4526-90a2-6d811cc92c76 for instance 1a263534-d906-4c7d-9b25-88e0aca68b0c on hv-cinder-82549 May 19 15:11:00.463101 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-82e25fe8-9a68-444d-b5e4-28e389b9b052 req-b210a9b1-d937-485d-a669-78fb44584d46 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030954 May 19 15:11:00.463948 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 301/598] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:11:00.481774 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-3117147f-5b0c-41e5-84af-135d34922ac9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lazy-loading 'flavor' on Instance uuid 7516d806-e895-4839-8142-5209040d1f2f {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:11:00.743958 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-3117147f-5b0c-41e5-84af-135d34922ac9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "POST /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f/action" status: 202 len: 0 microversion: 2.20 time: 0.301134 May 19 15:11:00.744964 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 298/599] 10.222.0.24 () {62 vars in 1318 bytes} [Thu May 19 15:11:00 2022] POST /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 15:11:00.753253 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-68afc9cc-35e6-4017-9e32-1fddb07d1a4f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:00.753976 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-68afc9cc-35e6-4017-9e32-1fddb07d1a4f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:00.760860 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-68afc9cc-35e6-4017-9e32-1fddb07d1a4f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:00.761313 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-68afc9cc-35e6-4017-9e32-1fddb07d1a4f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:00.762083 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-68afc9cc-35e6-4017-9e32-1fddb07d1a4f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:00.762522 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-68afc9cc-35e6-4017-9e32-1fddb07d1a4f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:00.897392 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-68afc9cc-35e6-4017-9e32-1fddb07d1a4f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:00.905517 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-68afc9cc-35e6-4017-9e32-1fddb07d1a4f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:00.907097 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-68afc9cc-35e6-4017-9e32-1fddb07d1a4f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:00.908294 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-68afc9cc-35e6-4017-9e32-1fddb07d1a4f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.159333 May 19 15:11:00.908858 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 302/600] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:00 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:11:01.117622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b90ed34e-edc3-461d-b63d-412496989b99 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:01.118997 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b90ed34e-edc3-461d-b63d-412496989b99 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:01.126334 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b90ed34e-edc3-461d-b63d-412496989b99 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:01.127309 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b90ed34e-edc3-461d-b63d-412496989b99 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:01.128345 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b90ed34e-edc3-461d-b63d-412496989b99 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:01.128993 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b90ed34e-edc3-461d-b63d-412496989b99 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:01.287874 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-b90ed34e-edc3-461d-b63d-412496989b99 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:01.296542 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-b90ed34e-edc3-461d-b63d-412496989b99 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1364 microversion: 2.1 time: 0.194124 May 19 15:11:01.299378 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 299/601] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:01 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:01.928557 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-24dd6b04-858a-4046-aafd-ed065ec85ea2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:01.929957 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-24dd6b04-858a-4046-aafd-ed065ec85ea2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:01.936716 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-24dd6b04-858a-4046-aafd-ed065ec85ea2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:01.937178 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-24dd6b04-858a-4046-aafd-ed065ec85ea2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:01.937966 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-24dd6b04-858a-4046-aafd-ed065ec85ea2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:01.938414 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-24dd6b04-858a-4046-aafd-ed065ec85ea2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:02.079900 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-24dd6b04-858a-4046-aafd-ed065ec85ea2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:02.087912 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-24dd6b04-858a-4046-aafd-ed065ec85ea2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:02.089429 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-24dd6b04-858a-4046-aafd-ed065ec85ea2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:02.090606 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-24dd6b04-858a-4046-aafd-ed065ec85ea2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.166834 May 19 15:11:02.091166 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 303/602] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:01 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:02.317986 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7334a4d3-dc08-4d35-81fd-022f567ff090 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:02.318620 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7334a4d3-dc08-4d35-81fd-022f567ff090 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:02.325274 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7334a4d3-dc08-4d35-81fd-022f567ff090 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:02.325732 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7334a4d3-dc08-4d35-81fd-022f567ff090 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:02.326506 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7334a4d3-dc08-4d35-81fd-022f567ff090 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:02.326950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7334a4d3-dc08-4d35-81fd-022f567ff090 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:02.459405 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7334a4d3-dc08-4d35-81fd-022f567ff090 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:02.466834 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7334a4d3-dc08-4d35-81fd-022f567ff090 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1364 microversion: 2.1 time: 0.152705 May 19 15:11:02.467433 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 300/603] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:02 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:03.109003 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f93ef477-ac16-4756-8c70-41d0701e70de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:03.109690 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f93ef477-ac16-4756-8c70-41d0701e70de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:03.117169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f93ef477-ac16-4756-8c70-41d0701e70de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:03.117624 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f93ef477-ac16-4756-8c70-41d0701e70de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:03.118656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f93ef477-ac16-4756-8c70-41d0701e70de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:03.119129 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f93ef477-ac16-4756-8c70-41d0701e70de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:03.256088 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f93ef477-ac16-4756-8c70-41d0701e70de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:03.264375 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f93ef477-ac16-4756-8c70-41d0701e70de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:03.265904 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f93ef477-ac16-4756-8c70-41d0701e70de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:03.267079 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f93ef477-ac16-4756-8c70-41d0701e70de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.162235 May 19 15:11:03.267677 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 304/604] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:03 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:03.484437 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6dd10748-deb2-4081-b42c-acdaf87fd4da tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:03.485083 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-6dd10748-deb2-4081-b42c-acdaf87fd4da tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:03.491559 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6dd10748-deb2-4081-b42c-acdaf87fd4da tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:03.492015 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6dd10748-deb2-4081-b42c-acdaf87fd4da tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:03.492784 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6dd10748-deb2-4081-b42c-acdaf87fd4da tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:03.493225 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6dd10748-deb2-4081-b42c-acdaf87fd4da tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:03.622516 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6dd10748-deb2-4081-b42c-acdaf87fd4da tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:03.630744 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6dd10748-deb2-4081-b42c-acdaf87fd4da tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1364 microversion: 2.1 time: 0.149641 May 19 15:11:03.631399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 301/605] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:03 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:04.285832 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a3228291-8d00-4a74-8ce2-faa12ca6a912 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:04.286441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a3228291-8d00-4a74-8ce2-faa12ca6a912 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:04.292886 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3228291-8d00-4a74-8ce2-faa12ca6a912 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:04.293335 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3228291-8d00-4a74-8ce2-faa12ca6a912 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:04.294090 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3228291-8d00-4a74-8ce2-faa12ca6a912 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:04.294522 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a3228291-8d00-4a74-8ce2-faa12ca6a912 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:04.428865 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a3228291-8d00-4a74-8ce2-faa12ca6a912 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:04.436942 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a3228291-8d00-4a74-8ce2-faa12ca6a912 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:04.438469 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a3228291-8d00-4a74-8ce2-faa12ca6a912 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:04.439648 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a3228291-8d00-4a74-8ce2-faa12ca6a912 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.157695 May 19 15:11:04.440204 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 305/606] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:04 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:04.647535 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-742cf809-4b83-428f-a88e-9bdd13c3e896 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:04.648153 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-742cf809-4b83-428f-a88e-9bdd13c3e896 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:04.654580 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-742cf809-4b83-428f-a88e-9bdd13c3e896 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:04.655044 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-742cf809-4b83-428f-a88e-9bdd13c3e896 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:04.655853 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-742cf809-4b83-428f-a88e-9bdd13c3e896 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:04.656293 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-742cf809-4b83-428f-a88e-9bdd13c3e896 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:04.784950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-742cf809-4b83-428f-a88e-9bdd13c3e896 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:04.792905 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-742cf809-4b83-428f-a88e-9bdd13c3e896 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1364 microversion: 2.1 time: 0.149296 May 19 15:11:04.793473 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 302/607] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:04 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:05.407357 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-55f0aed3-b115-4533-aca5-5b64294bad2f req-e3f7e542-6ac3-4838-aee9-0165b5e5b526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20c74e3-1f32-4118-b98b-2e60725d9ea2", "name": "network-vif-plugged", "status": "completed", "tag": "ccdc4c36-ce1d-470e-9208-6ea0c0ff6e38"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:05.415506 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-55f0aed3-b115-4533-aca5-5b64294bad2f req-e3f7e542-6ac3-4838-aee9-0165b5e5b526 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:05.415950 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-55f0aed3-b115-4533-aca5-5b64294bad2f req-e3f7e542-6ac3-4838-aee9-0165b5e5b526 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:05.426391 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-55f0aed3-b115-4533-aca5-5b64294bad2f req-e3f7e542-6ac3-4838-aee9-0165b5e5b526 service nova] Creating event network-vif-plugged:ccdc4c36-ce1d-470e-9208-6ea0c0ff6e38 for instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 on hv-cinder-82549 May 19 15:11:05.431264 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-55f0aed3-b115-4533-aca5-5b64294bad2f req-e3f7e542-6ac3-4838-aee9-0165b5e5b526 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085573 May 19 15:11:05.431840 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 306/608] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:11:05.457911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-56983693-7a79-4b8b-9d8a-2e5c9a271852 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:05.459043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-56983693-7a79-4b8b-9d8a-2e5c9a271852 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:05.465136 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-56983693-7a79-4b8b-9d8a-2e5c9a271852 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:05.465595 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-56983693-7a79-4b8b-9d8a-2e5c9a271852 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:05.466584 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-56983693-7a79-4b8b-9d8a-2e5c9a271852 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:05.467091 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-56983693-7a79-4b8b-9d8a-2e5c9a271852 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:05.598703 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-56983693-7a79-4b8b-9d8a-2e5c9a271852 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:05.607445 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-56983693-7a79-4b8b-9d8a-2e5c9a271852 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:05.608658 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-56983693-7a79-4b8b-9d8a-2e5c9a271852 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:05.610163 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-56983693-7a79-4b8b-9d8a-2e5c9a271852 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.156281 May 19 15:11:05.611313 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 303/609] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:05 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:05.810561 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-88649552-4a06-45d0-ae7d-2bc4d69c2556 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:05.811224 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-88649552-4a06-45d0-ae7d-2bc4d69c2556 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:05.817872 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88649552-4a06-45d0-ae7d-2bc4d69c2556 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:05.818318 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88649552-4a06-45d0-ae7d-2bc4d69c2556 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:05.819074 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88649552-4a06-45d0-ae7d-2bc4d69c2556 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:05.819538 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-88649552-4a06-45d0-ae7d-2bc4d69c2556 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:05.953716 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-88649552-4a06-45d0-ae7d-2bc4d69c2556 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:05.962366 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-88649552-4a06-45d0-ae7d-2bc4d69c2556 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1364 microversion: 2.1 time: 0.156052 May 19 15:11:05.962975 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 307/610] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:05 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:06.628224 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9af9376d-b5c5-449a-80fd-d549b8d6a3de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:06.628832 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-9af9376d-b5c5-449a-80fd-d549b8d6a3de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:06.631348 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=16 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:06.637172 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9af9376d-b5c5-449a-80fd-d549b8d6a3de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:06.637633 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9af9376d-b5c5-449a-80fd-d549b8d6a3de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:06.638413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9af9376d-b5c5-449a-80fd-d549b8d6a3de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:06.638854 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9af9376d-b5c5-449a-80fd-d549b8d6a3de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:06.771682 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9af9376d-b5c5-449a-80fd-d549b8d6a3de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:06.779555 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9af9376d-b5c5-449a-80fd-d549b8d6a3de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:06.781059 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9af9376d-b5c5-449a-80fd-d549b8d6a3de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:06.782218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9af9376d-b5c5-449a-80fd-d549b8d6a3de tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.157921 May 19 15:11:06.782776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 304/611] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:06 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:06.978598 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ead36693-0432-431f-a0b3-aedc9a38c426 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:06.979228 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ead36693-0432-431f-a0b3-aedc9a38c426 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:06.981170 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=4 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:06.981847 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=14 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:06.988525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ead36693-0432-431f-a0b3-aedc9a38c426 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:06.989482 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ead36693-0432-431f-a0b3-aedc9a38c426 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:06.990261 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ead36693-0432-431f-a0b3-aedc9a38c426 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:06.990704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ead36693-0432-431f-a0b3-aedc9a38c426 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:07.120056 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ead36693-0432-431f-a0b3-aedc9a38c426 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:07.127406 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ead36693-0432-431f-a0b3-aedc9a38c426 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1364 microversion: 2.1 time: 0.152632 May 19 15:11:07.127964 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 308/612] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:06 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:07.800849 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3a4902b9-e502-4207-a1e1-2b30d35af113 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:07.801456 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-3a4902b9-e502-4207-a1e1-2b30d35af113 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:07.807974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3a4902b9-e502-4207-a1e1-2b30d35af113 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:07.808425 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3a4902b9-e502-4207-a1e1-2b30d35af113 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:07.809188 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3a4902b9-e502-4207-a1e1-2b30d35af113 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:07.809628 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3a4902b9-e502-4207-a1e1-2b30d35af113 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:07.943561 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-3a4902b9-e502-4207-a1e1-2b30d35af113 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:07.952213 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-3a4902b9-e502-4207-a1e1-2b30d35af113 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:07.953910 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-3a4902b9-e502-4207-a1e1-2b30d35af113 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:07.955322 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-3a4902b9-e502-4207-a1e1-2b30d35af113 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.158377 May 19 15:11:07.955889 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 305/613] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:07 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:08.144984 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5baef80c-9f5f-4ae7-9c30-baa223e9796d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:08.146244 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5baef80c-9f5f-4ae7-9c30-baa223e9796d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:08.152709 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5baef80c-9f5f-4ae7-9c30-baa223e9796d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:08.153163 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5baef80c-9f5f-4ae7-9c30-baa223e9796d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:08.153928 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5baef80c-9f5f-4ae7-9c30-baa223e9796d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:08.154366 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5baef80c-9f5f-4ae7-9c30-baa223e9796d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:08.283983 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5baef80c-9f5f-4ae7-9c30-baa223e9796d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:08.291448 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5baef80c-9f5f-4ae7-9c30-baa223e9796d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1550 microversion: 2.1 time: 0.150302 May 19 15:11:08.292021 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 309/614] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:08 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:08.307519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d4016d10-2934-4724-91a3-960f0782a864 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:08.307990 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-d4016d10-2934-4724-91a3-960f0782a864 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:08.314020 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d4016d10-2934-4724-91a3-960f0782a864 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:08.314469 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d4016d10-2934-4724-91a3-960f0782a864 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:08.315249 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d4016d10-2934-4724-91a3-960f0782a864 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:08.315686 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d4016d10-2934-4724-91a3-960f0782a864 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:08.390879 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-d4016d10-2934-4724-91a3-960f0782a864 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087157 May 19 15:11:08.391502 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 306/615] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 15:11:08 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:11:08.978685 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4be5c417-b18e-462c-b066-25062693a9bc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:08.979327 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4be5c417-b18e-462c-b066-25062693a9bc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:08.985539 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4be5c417-b18e-462c-b066-25062693a9bc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:08.986017 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4be5c417-b18e-462c-b066-25062693a9bc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:08.986793 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4be5c417-b18e-462c-b066-25062693a9bc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:08.987299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4be5c417-b18e-462c-b066-25062693a9bc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:09.221220 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4be5c417-b18e-462c-b066-25062693a9bc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:09.231797 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4be5c417-b18e-462c-b066-25062693a9bc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:09.235256 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4be5c417-b18e-462c-b066-25062693a9bc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:09.236624 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4be5c417-b18e-462c-b066-25062693a9bc tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.261804 May 19 15:11:09.241637 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 310/616] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:08 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:11:09.254268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c33952ce-e6ed-4c3f-a452-39dfff368a9a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:09.255481 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c33952ce-e6ed-4c3f-a452-39dfff368a9a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:09.261536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c33952ce-e6ed-4c3f-a452-39dfff368a9a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:09.261992 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c33952ce-e6ed-4c3f-a452-39dfff368a9a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:09.262769 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c33952ce-e6ed-4c3f-a452-39dfff368a9a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:09.263225 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c33952ce-e6ed-4c3f-a452-39dfff368a9a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:09.287270 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c33952ce-e6ed-4c3f-a452-39dfff368a9a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Going to try to terminate instance {{(pid=117445) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:11:09.319049 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:09.380985 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c33952ce-e6ed-4c3f-a452-39dfff368a9a tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 204 len: 0 microversion: 2.1 time: 0.130218 May 19 15:11:09.381832 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 307/617] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:11:09 2022] DELETE /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:11:09.392570 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-23a06cee-e0ff-4559-9a6b-861146f51128 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:09.393461 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-23a06cee-e0ff-4559-9a6b-861146f51128 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:09.400666 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-23a06cee-e0ff-4559-9a6b-861146f51128 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:09.401125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-23a06cee-e0ff-4559-9a6b-861146f51128 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:09.402098 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-23a06cee-e0ff-4559-9a6b-861146f51128 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:09.402731 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-23a06cee-e0ff-4559-9a6b-861146f51128 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:09.455944 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-5e698f49-8931-4a8c-838d-0b476410f28e req-eb4c011b-eb43-4211-8c89-ff39d0c4dc29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20c74e3-1f32-4118-b98b-2e60725d9ea2", "tag": "ccdc4c36-ce1d-470e-9208-6ea0c0ff6e38"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:09.464551 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-5e698f49-8931-4a8c-838d-0b476410f28e req-eb4c011b-eb43-4211-8c89-ff39d0c4dc29 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:09.464962 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-5e698f49-8931-4a8c-838d-0b476410f28e req-eb4c011b-eb43-4211-8c89-ff39d0c4dc29 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:09.476837 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-5e698f49-8931-4a8c-838d-0b476410f28e req-eb4c011b-eb43-4211-8c89-ff39d0c4dc29 service nova] Creating event network-changed:ccdc4c36-ce1d-470e-9208-6ea0c0ff6e38 for instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 on hv-cinder-82549 May 19 15:11:09.482598 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-5e698f49-8931-4a8c-838d-0b476410f28e req-eb4c011b-eb43-4211-8c89-ff39d0c4dc29 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090966 May 19 15:11:09.483152 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 308/618] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:11:09.548951 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-23a06cee-e0ff-4559-9a6b-861146f51128 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:09.557033 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-23a06cee-e0ff-4559-9a6b-861146f51128 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1577 microversion: 2.1 time: 0.169564 May 19 15:11:09.557609 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 311/619] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:09 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:10.257297 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-8854f7c2-16c5-42e7-a734-7c492e09fc22 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:10.257991 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-8854f7c2-16c5-42e7-a734-7c492e09fc22 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:10.264369 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8854f7c2-16c5-42e7-a734-7c492e09fc22 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:10.264817 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8854f7c2-16c5-42e7-a734-7c492e09fc22 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:10.265581 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8854f7c2-16c5-42e7-a734-7c492e09fc22 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:10.266033 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8854f7c2-16c5-42e7-a734-7c492e09fc22 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:10.398762 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8854f7c2-16c5-42e7-a734-7c492e09fc22 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:10.406715 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8854f7c2-16c5-42e7-a734-7c492e09fc22 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:10.408523 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8854f7c2-16c5-42e7-a734-7c492e09fc22 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:10.409721 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-8854f7c2-16c5-42e7-a734-7c492e09fc22 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.157190 May 19 15:11:10.410282 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 309/620] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:10 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:11:10.574327 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-bffc6bed-9bc8-444b-87a2-d8d2a789bbaf tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:10.574949 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bffc6bed-9bc8-444b-87a2-d8d2a789bbaf tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:10.581390 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bffc6bed-9bc8-444b-87a2-d8d2a789bbaf tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:10.581852 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bffc6bed-9bc8-444b-87a2-d8d2a789bbaf tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:10.583223 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bffc6bed-9bc8-444b-87a2-d8d2a789bbaf tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:10.583679 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bffc6bed-9bc8-444b-87a2-d8d2a789bbaf tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:10.715593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-bffc6bed-9bc8-444b-87a2-d8d2a789bbaf tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:10.723858 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-bffc6bed-9bc8-444b-87a2-d8d2a789bbaf tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1577 microversion: 2.1 time: 0.153216 May 19 15:11:10.734052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 312/621] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:10 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:11.428142 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d7ac8242-d0df-4ccf-aeff-4c13ebb71587 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:11.428777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-d7ac8242-d0df-4ccf-aeff-4c13ebb71587 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:11.435654 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d7ac8242-d0df-4ccf-aeff-4c13ebb71587 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:11.436111 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d7ac8242-d0df-4ccf-aeff-4c13ebb71587 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:11.436902 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d7ac8242-d0df-4ccf-aeff-4c13ebb71587 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:11.437358 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d7ac8242-d0df-4ccf-aeff-4c13ebb71587 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:11.572091 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-d7ac8242-d0df-4ccf-aeff-4c13ebb71587 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:11.581251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-d7ac8242-d0df-4ccf-aeff-4c13ebb71587 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:11.582822 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-d7ac8242-d0df-4ccf-aeff-4c13ebb71587 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:11.584035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-d7ac8242-d0df-4ccf-aeff-4c13ebb71587 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.159945 May 19 15:11:11.584594 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 310/622] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:11 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:11.742027 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6b7b0704-80e7-4cd3-928a-d80cc5339c7d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:11.742647 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6b7b0704-80e7-4cd3-928a-d80cc5339c7d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:11.749570 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6b7b0704-80e7-4cd3-928a-d80cc5339c7d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:11.750037 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6b7b0704-80e7-4cd3-928a-d80cc5339c7d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:11.750811 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6b7b0704-80e7-4cd3-928a-d80cc5339c7d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:11.751297 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6b7b0704-80e7-4cd3-928a-d80cc5339c7d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:11.880500 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6b7b0704-80e7-4cd3-928a-d80cc5339c7d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:11.888371 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6b7b0704-80e7-4cd3-928a-d80cc5339c7d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1577 microversion: 2.1 time: 0.150767 May 19 15:11:11.888952 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 313/623] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:11 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:12.267942 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-f1d02018-b148-4dbf-8b3a-3ad77c6032cb req-4d7e3abc-39b6-4aff-9240-78fcb74393e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a43fdf07-dfad-4813-9f02-1de4e886eb18", "name": "network-vif-deleted", "tag": "6d4f2f1d-bc4f-469b-a086-62fc903f5044"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:12.279555 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-f1d02018-b148-4dbf-8b3a-3ad77c6032cb req-4d7e3abc-39b6-4aff-9240-78fcb74393e7 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:12.280137 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-f1d02018-b148-4dbf-8b3a-3ad77c6032cb req-4d7e3abc-39b6-4aff-9240-78fcb74393e7 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:12.293730 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-f1d02018-b148-4dbf-8b3a-3ad77c6032cb req-4d7e3abc-39b6-4aff-9240-78fcb74393e7 service nova] Creating event network-vif-deleted:6d4f2f1d-bc4f-469b-a086-62fc903f5044 for instance a43fdf07-dfad-4813-9f02-1de4e886eb18 on hv-cinder-82549 May 19 15:11:12.299244 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-f1d02018-b148-4dbf-8b3a-3ad77c6032cb req-4d7e3abc-39b6-4aff-9240-78fcb74393e7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035230 May 19 15:11:12.300021 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 311/624] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:11:12.602670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e1a8746a-740f-438e-be1c-efcb82ba8223 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:12.603253 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e1a8746a-740f-438e-be1c-efcb82ba8223 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:12.610310 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1a8746a-740f-438e-be1c-efcb82ba8223 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:12.610948 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1a8746a-740f-438e-be1c-efcb82ba8223 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:12.611913 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1a8746a-740f-438e-be1c-efcb82ba8223 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:12.612541 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1a8746a-740f-438e-be1c-efcb82ba8223 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:12.744614 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e1a8746a-740f-438e-be1c-efcb82ba8223 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:12.753153 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e1a8746a-740f-438e-be1c-efcb82ba8223 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:12.755098 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e1a8746a-740f-438e-be1c-efcb82ba8223 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:12.756330 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e1a8746a-740f-438e-be1c-efcb82ba8223 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.158175 May 19 15:11:12.756889 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 314/625] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:12 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:12.906223 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f53c4c5b-a08a-4f35-b38d-cc6ac2afd7bc tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:12.907003 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f53c4c5b-a08a-4f35-b38d-cc6ac2afd7bc tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:12.913556 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f53c4c5b-a08a-4f35-b38d-cc6ac2afd7bc tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:12.914006 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f53c4c5b-a08a-4f35-b38d-cc6ac2afd7bc tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:12.914775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f53c4c5b-a08a-4f35-b38d-cc6ac2afd7bc tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:12.915229 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f53c4c5b-a08a-4f35-b38d-cc6ac2afd7bc tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:12.948857 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f53c4c5b-a08a-4f35-b38d-cc6ac2afd7bc tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:12.949407 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f53c4c5b-a08a-4f35-b38d-cc6ac2afd7bc tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:12.950366 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-f53c4c5b-a08a-4f35-b38d-cc6ac2afd7bc tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lazy-loading 'fault' on Instance uuid a43fdf07-dfad-4813-9f02-1de4e886eb18 {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:11:12.994898 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f53c4c5b-a08a-4f35-b38d-cc6ac2afd7bc tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:13.003060 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f53c4c5b-a08a-4f35-b38d-cc6ac2afd7bc tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 200 len: 1231 microversion: 2.1 time: 0.101529 May 19 15:11:13.004087 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 312/626] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:12 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:13.774751 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d9c4b74e-7d19-4f74-a8f9-f2f0b299fac6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:13.775395 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d9c4b74e-7d19-4f74-a8f9-f2f0b299fac6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:13.781864 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d9c4b74e-7d19-4f74-a8f9-f2f0b299fac6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:13.782311 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d9c4b74e-7d19-4f74-a8f9-f2f0b299fac6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:13.783066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d9c4b74e-7d19-4f74-a8f9-f2f0b299fac6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:13.783537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d9c4b74e-7d19-4f74-a8f9-f2f0b299fac6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:13.910532 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d9c4b74e-7d19-4f74-a8f9-f2f0b299fac6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:13.918951 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d9c4b74e-7d19-4f74-a8f9-f2f0b299fac6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:13.920478 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d9c4b74e-7d19-4f74-a8f9-f2f0b299fac6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:13.921630 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d9c4b74e-7d19-4f74-a8f9-f2f0b299fac6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.151289 May 19 15:11:13.922191 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 315/627] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:13 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:14.020081 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9dce196b-bf1d-4dc6-b0be-54fb6b47efe0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:14.021184 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-9dce196b-bf1d-4dc6-b0be-54fb6b47efe0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:14.027795 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9dce196b-bf1d-4dc6-b0be-54fb6b47efe0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:14.028194 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9dce196b-bf1d-4dc6-b0be-54fb6b47efe0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:14.028967 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9dce196b-bf1d-4dc6-b0be-54fb6b47efe0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:14.029409 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9dce196b-bf1d-4dc6-b0be-54fb6b47efe0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:14.044078 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-9dce196b-bf1d-4dc6-b0be-54fb6b47efe0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] HTTP exception thrown: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9dce196b-bf1d-4dc6-b0be-54fb6b47efe0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Request method failure captured: May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 HTTP/1.1 May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihl1BvK4FVLhQp8fmrOD3HDkNabIZHMyu1Qkda5ry3i8u1dZf2C9j28bYeZWARdOYsaFtdcD24rO8SbDeEgfFXKqbY8KgMnYRLzfTpjabFplhT8CqU0xt1lrLplZmZ6LMGhKB0dErYLv5NCH30jsKrc6xvkjg9ycO6_07Yng8z-8RU3s May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 2c71bc8f0a164884bc0c046fd1e7faab May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-TestVolumeBootPattern-755449471 May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:11:14.046110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:11:14.047711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2c71bc8f0a164884bc0c046fd1e7faab", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2c71bc8f0a164884bc0c046fd1e7faab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2c71bc8f0a164884bc0c046fd1e7faab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2c71bc8f0a164884bc0c046fd1e7faab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:11:14.047711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-TestVolumeBootPattern-755449471 May 19 15:11:14.047711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 2c71bc8f0a164884bc0c046fd1e7faab May 19 15:11:14.047711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-TestVolumeBootPattern-755449471 May 19 15:11:14.047711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-TestVolumeBootPattern-755449471-project May 19 15:11:14.047711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:11:14.047711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:11:14.047711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 9877b9bbc14141bba21625fc8f1046d2 May 19 15:11:14.047711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-TestVolumeBootPattern-755449471-project May 19 15:11:14.047711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:11:14.047711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. May 19 15:11:14.047711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': 'a43fdf07-dfad-4813-9f02-1de4e886eb18'} May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:11:14.048515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. May 19 15:11:14.049777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:11:14.050884 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9dce196b-bf1d-4dc6-b0be-54fb6b47efe0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Returning 404 to user: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:11:14.050884 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9dce196b-bf1d-4dc6-b0be-54fb6b47efe0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 404 len: 111 microversion: 2.1 time: 0.031188 May 19 15:11:14.050884 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 313/628] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:14 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:11:14.142954 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-103990792", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1235658748", "security_groups": [{"name": "tempest-secgroup-smoke-1975589445"}], "block_device_mapping_v2": [{"uuid": "6aca48af-8857-4092-b68d-23c9cfd05419", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c953f990-ab01-4a12-ad62-ff0b653ea46c"}]}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:14.249992 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] validate_networks() for [('c953f990-ab01-4a12-ad62-ff0b653ea46c', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:11:14.616981 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:11:14.617404 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:11:14.617875 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:11:14.618568 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:11:14.618956 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:11:14.628199 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:14.628650 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:14.629453 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:14.630498 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:14.646476 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Getting quotas for project 2c71bc8f0a164884bc0c046fd1e7faab. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:11:14.650346 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Getting quotas for user 9877b9bbc14141bba21625fc8f1046d2 and project 2c71bc8f0a164884bc0c046fd1e7faab. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:11:14.706643 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:11:14.708751 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6aca48af-8857-4092-b68d-23c9cfd05419',volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:11:14.834308 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9f428628-017d-4119-add5-154ee18d3256 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.695174 May 19 15:11:14.835270 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 316/629] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:11:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:11:14.845039 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-98650b4e-e265-4639-a0c9-f9a335f58ac5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:14.845661 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-98650b4e-e265-4639-a0c9-f9a335f58ac5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:14.899699 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-98650b4e-e265-4639-a0c9-f9a335f58ac5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:14.906323 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-98650b4e-e265-4639-a0c9-f9a335f58ac5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1094 microversion: 2.1 time: 0.065090 May 19 15:11:14.906891 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 314/630] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:14 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:14.939625 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5108fffe-6313-4d14-8d58-889261f21348 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:14.940332 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5108fffe-6313-4d14-8d58-889261f21348 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:14.949626 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5108fffe-6313-4d14-8d58-889261f21348 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:14.950339 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5108fffe-6313-4d14-8d58-889261f21348 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:14.951243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5108fffe-6313-4d14-8d58-889261f21348 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:14.951820 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5108fffe-6313-4d14-8d58-889261f21348 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:15.084482 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5108fffe-6313-4d14-8d58-889261f21348 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:15.093747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5108fffe-6313-4d14-8d58-889261f21348 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:15.095765 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5108fffe-6313-4d14-8d58-889261f21348 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:15.097299 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5108fffe-6313-4d14-8d58-889261f21348 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.161617 May 19 15:11:15.098048 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 317/631] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:14 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:15.923399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-29b685e0-c984-4361-b50f-f72e537dcef1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:15.924013 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-29b685e0-c984-4361-b50f-f72e537dcef1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:15.933177 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-29b685e0-c984-4361-b50f-f72e537dcef1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:15.933881 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-29b685e0-c984-4361-b50f-f72e537dcef1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:15.934831 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-29b685e0-c984-4361-b50f-f72e537dcef1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:15.935447 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-29b685e0-c984-4361-b50f-f72e537dcef1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:16.002332 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-29b685e0-c984-4361-b50f-f72e537dcef1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:16.010408 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-29b685e0-c984-4361-b50f-f72e537dcef1 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1210 microversion: 2.1 time: 0.090787 May 19 15:11:16.010972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 315/632] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:15 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:16.116994 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-80d2d97b-395a-426e-9147-bfd4422e97ae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:16.117576 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-80d2d97b-395a-426e-9147-bfd4422e97ae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:16.124185 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-80d2d97b-395a-426e-9147-bfd4422e97ae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:16.124637 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-80d2d97b-395a-426e-9147-bfd4422e97ae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:16.125397 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-80d2d97b-395a-426e-9147-bfd4422e97ae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:16.125828 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-80d2d97b-395a-426e-9147-bfd4422e97ae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:16.266505 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-80d2d97b-395a-426e-9147-bfd4422e97ae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:16.280451 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-80d2d97b-395a-426e-9147-bfd4422e97ae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:16.282193 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-80d2d97b-395a-426e-9147-bfd4422e97ae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:16.283500 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-80d2d97b-395a-426e-9147-bfd4422e97ae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.170936 May 19 15:11:16.284452 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 318/633] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:16 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:17.029792 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-09e1485c-08f7-4794-86dc-a7d260d5bc47 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:17.030732 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-09e1485c-08f7-4794-86dc-a7d260d5bc47 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:17.038328 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-09e1485c-08f7-4794-86dc-a7d260d5bc47 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:17.038787 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-09e1485c-08f7-4794-86dc-a7d260d5bc47 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:17.039605 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-09e1485c-08f7-4794-86dc-a7d260d5bc47 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:17.040076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-09e1485c-08f7-4794-86dc-a7d260d5bc47 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:17.197409 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-09e1485c-08f7-4794-86dc-a7d260d5bc47 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:17.205249 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-09e1485c-08f7-4794-86dc-a7d260d5bc47 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1266 microversion: 2.1 time: 0.179583 May 19 15:11:17.205905 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 316/634] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:17 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:17.253089 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-a9c122ef-4e51-4964-ab1a-7159a233564a req-7c0b69b5-bb86-41c9-a032-83dcc1b82195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0116d16f-6546-42a0-8274-22fc3577000b", "tag": "a9f91331-2ea7-4396-8799-ffc363f22091"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:17.265856 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-a9c122ef-4e51-4964-ab1a-7159a233564a req-7c0b69b5-bb86-41c9-a032-83dcc1b82195 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:17.267388 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-a9c122ef-4e51-4964-ab1a-7159a233564a req-7c0b69b5-bb86-41c9-a032-83dcc1b82195 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:17.284836 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-a9c122ef-4e51-4964-ab1a-7159a233564a req-7c0b69b5-bb86-41c9-a032-83dcc1b82195 service nova] Creating event network-changed:a9f91331-2ea7-4396-8799-ffc363f22091 for instance 0116d16f-6546-42a0-8274-22fc3577000b on hv-cinder-82549 May 19 15:11:17.290890 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-a9c122ef-4e51-4964-ab1a-7159a233564a req-7c0b69b5-bb86-41c9-a032-83dcc1b82195 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041506 May 19 15:11:17.291514 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 319/635] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:11:17.303683 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e78e1984-445e-4171-a0bb-03b19e02e894 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:17.304565 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e78e1984-445e-4171-a0bb-03b19e02e894 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:17.311140 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e78e1984-445e-4171-a0bb-03b19e02e894 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:17.311818 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e78e1984-445e-4171-a0bb-03b19e02e894 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:17.312814 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e78e1984-445e-4171-a0bb-03b19e02e894 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:17.313255 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e78e1984-445e-4171-a0bb-03b19e02e894 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:17.478100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e78e1984-445e-4171-a0bb-03b19e02e894 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:17.486401 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e78e1984-445e-4171-a0bb-03b19e02e894 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:17.487954 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e78e1984-445e-4171-a0bb-03b19e02e894 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:17.489126 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e78e1984-445e-4171-a0bb-03b19e02e894 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1741 microversion: 2.20 time: 0.190156 May 19 15:11:17.500393 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 317/636] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:17 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1741 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:18.222483 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-77b559d3-5d56-4e5e-9ac0-99fe3a86e791 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:18.223218 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-77b559d3-5d56-4e5e-9ac0-99fe3a86e791 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:18.229420 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-77b559d3-5d56-4e5e-9ac0-99fe3a86e791 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:18.229885 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-77b559d3-5d56-4e5e-9ac0-99fe3a86e791 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:18.230665 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-77b559d3-5d56-4e5e-9ac0-99fe3a86e791 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:18.231109 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-77b559d3-5d56-4e5e-9ac0-99fe3a86e791 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:18.235165 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=100 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:18.361811 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-77b559d3-5d56-4e5e-9ac0-99fe3a86e791 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:18.370322 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-77b559d3-5d56-4e5e-9ac0-99fe3a86e791 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1266 microversion: 2.1 time: 0.152206 May 19 15:11:18.370906 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 320/637] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:18 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:18.508407 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7907971a-7f8d-4ea2-a983-e4df800b87a4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:18.509009 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7907971a-7f8d-4ea2-a983-e4df800b87a4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:18.515394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7907971a-7f8d-4ea2-a983-e4df800b87a4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:18.515843 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7907971a-7f8d-4ea2-a983-e4df800b87a4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:18.516618 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7907971a-7f8d-4ea2-a983-e4df800b87a4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:18.517057 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7907971a-7f8d-4ea2-a983-e4df800b87a4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:18.647184 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7907971a-7f8d-4ea2-a983-e4df800b87a4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:18.655077 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7907971a-7f8d-4ea2-a983-e4df800b87a4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:18.656609 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7907971a-7f8d-4ea2-a983-e4df800b87a4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:18.657766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7907971a-7f8d-4ea2-a983-e4df800b87a4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1741 microversion: 2.20 time: 0.153811 May 19 15:11:18.658324 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 318/638] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:18 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:19.387101 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c0c18d3f-b1d6-48f9-b6de-f79caf2f0396 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:19.388297 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c0c18d3f-b1d6-48f9-b6de-f79caf2f0396 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:19.394791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0c18d3f-b1d6-48f9-b6de-f79caf2f0396 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:19.395463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0c18d3f-b1d6-48f9-b6de-f79caf2f0396 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:19.397030 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0c18d3f-b1d6-48f9-b6de-f79caf2f0396 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:19.397646 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0c18d3f-b1d6-48f9-b6de-f79caf2f0396 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:19.565203 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c0c18d3f-b1d6-48f9-b6de-f79caf2f0396 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:19.576972 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c0c18d3f-b1d6-48f9-b6de-f79caf2f0396 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1266 microversion: 2.1 time: 0.193711 May 19 15:11:19.577860 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 321/639] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:19 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:19.677707 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-20f46e1c-4e62-4217-9992-76d2d65f4b60 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:19.679279 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-20f46e1c-4e62-4217-9992-76d2d65f4b60 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:19.687023 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-20f46e1c-4e62-4217-9992-76d2d65f4b60 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:19.687783 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-20f46e1c-4e62-4217-9992-76d2d65f4b60 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:19.688789 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-20f46e1c-4e62-4217-9992-76d2d65f4b60 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:19.689388 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-20f46e1c-4e62-4217-9992-76d2d65f4b60 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:19.850990 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-20f46e1c-4e62-4217-9992-76d2d65f4b60 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:19.861934 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-20f46e1c-4e62-4217-9992-76d2d65f4b60 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:19.863473 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-20f46e1c-4e62-4217-9992-76d2d65f4b60 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:19.865560 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-20f46e1c-4e62-4217-9992-76d2d65f4b60 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1736 microversion: 2.20 time: 0.192903 May 19 15:11:19.866124 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 319/640] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:19 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:20.595798 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-beb5ec00-331a-4f8c-b5a5-76ed9bd3422c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:20.597095 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-beb5ec00-331a-4f8c-b5a5-76ed9bd3422c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:20.603701 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-beb5ec00-331a-4f8c-b5a5-76ed9bd3422c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:20.604365 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-beb5ec00-331a-4f8c-b5a5-76ed9bd3422c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:20.605149 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-beb5ec00-331a-4f8c-b5a5-76ed9bd3422c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:20.605590 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-beb5ec00-331a-4f8c-b5a5-76ed9bd3422c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:20.751445 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-beb5ec00-331a-4f8c-b5a5-76ed9bd3422c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:20.759511 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-beb5ec00-331a-4f8c-b5a5-76ed9bd3422c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1266 microversion: 2.1 time: 0.169338 May 19 15:11:20.760184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 322/641] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:20 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:20.886211 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-815b4916-0773-47a5-b3af-e1598dcc44fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:20.886750 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-815b4916-0773-47a5-b3af-e1598dcc44fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:20.893448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-815b4916-0773-47a5-b3af-e1598dcc44fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:20.893909 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-815b4916-0773-47a5-b3af-e1598dcc44fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:20.894704 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-815b4916-0773-47a5-b3af-e1598dcc44fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:20.895144 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-815b4916-0773-47a5-b3af-e1598dcc44fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:21.031026 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-815b4916-0773-47a5-b3af-e1598dcc44fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:21.040296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-815b4916-0773-47a5-b3af-e1598dcc44fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:21.043965 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-815b4916-0773-47a5-b3af-e1598dcc44fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:21.045564 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-815b4916-0773-47a5-b3af-e1598dcc44fa tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1736 microversion: 2.20 time: 0.163233 May 19 15:11:21.046304 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 320/642] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:20 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:21.585534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-2e20b38b-5531-4a9b-9824-f508cee6a668 req-c29366a8-1f8c-4b12-994a-c970cac8e66c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7516d806-e895-4839-8142-5209040d1f2f", "name": "network-vif-plugged", "status": "completed", "tag": "31aad5e7-16b4-45c8-b12a-2912bed903a1"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:21.595447 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-2e20b38b-5531-4a9b-9824-f508cee6a668 req-c29366a8-1f8c-4b12-994a-c970cac8e66c service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:21.596340 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-2e20b38b-5531-4a9b-9824-f508cee6a668 req-c29366a8-1f8c-4b12-994a-c970cac8e66c service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:21.620637 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-2e20b38b-5531-4a9b-9824-f508cee6a668 req-c29366a8-1f8c-4b12-994a-c970cac8e66c service nova] Creating event network-vif-plugged:31aad5e7-16b4-45c8-b12a-2912bed903a1 for instance 7516d806-e895-4839-8142-5209040d1f2f on hv-cinder-82549 May 19 15:11:21.626103 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-2e20b38b-5531-4a9b-9824-f508cee6a668 req-c29366a8-1f8c-4b12-994a-c970cac8e66c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044174 May 19 15:11:21.627188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 323/643] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:11:21.776970 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-74d70efa-566c-4981-a1e7-be44165338a5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:21.778025 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-74d70efa-566c-4981-a1e7-be44165338a5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:21.784479 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-74d70efa-566c-4981-a1e7-be44165338a5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:21.785223 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-74d70efa-566c-4981-a1e7-be44165338a5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:21.786067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-74d70efa-566c-4981-a1e7-be44165338a5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:21.786743 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-74d70efa-566c-4981-a1e7-be44165338a5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:21.934764 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-74d70efa-566c-4981-a1e7-be44165338a5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:21.944106 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-74d70efa-566c-4981-a1e7-be44165338a5 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1266 microversion: 2.1 time: 0.170973 May 19 15:11:21.944818 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 321/644] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:21 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:11:22.065280 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-98bd12b4-e2c4-4f5e-b9f3-7406a47874e7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:22.066157 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-98bd12b4-e2c4-4f5e-b9f3-7406a47874e7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:22.075603 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98bd12b4-e2c4-4f5e-b9f3-7406a47874e7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:22.080652 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98bd12b4-e2c4-4f5e-b9f3-7406a47874e7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:22.081643 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98bd12b4-e2c4-4f5e-b9f3-7406a47874e7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:22.082164 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98bd12b4-e2c4-4f5e-b9f3-7406a47874e7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:22.235883 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-98bd12b4-e2c4-4f5e-b9f3-7406a47874e7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:22.246428 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-98bd12b4-e2c4-4f5e-b9f3-7406a47874e7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:22.248377 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-98bd12b4-e2c4-4f5e-b9f3-7406a47874e7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:22.249735 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-98bd12b4-e2c4-4f5e-b9f3-7406a47874e7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1736 microversion: 2.20 time: 0.188729 May 19 15:11:22.250290 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 324/645] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:22 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:11:22.961481 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6bfafcd9-d8b6-44a1-8915-dfd263d90402 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:22.962829 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-6bfafcd9-d8b6-44a1-8915-dfd263d90402 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:22.968812 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:22.970490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6bfafcd9-d8b6-44a1-8915-dfd263d90402 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:22.970931 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6bfafcd9-d8b6-44a1-8915-dfd263d90402 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:22.971830 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6bfafcd9-d8b6-44a1-8915-dfd263d90402 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:22.972687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6bfafcd9-d8b6-44a1-8915-dfd263d90402 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:23.124206 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6bfafcd9-d8b6-44a1-8915-dfd263d90402 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:23.132197 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6bfafcd9-d8b6-44a1-8915-dfd263d90402 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1266 microversion: 2.1 time: 0.174562 May 19 15:11:23.144634 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 322/646] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:22 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:23.268315 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-23180c1d-8e1f-4671-bc95-321ead14c656 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:23.269569 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-23180c1d-8e1f-4671-bc95-321ead14c656 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:23.280385 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-23180c1d-8e1f-4671-bc95-321ead14c656 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:23.281121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-23180c1d-8e1f-4671-bc95-321ead14c656 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:23.282110 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-23180c1d-8e1f-4671-bc95-321ead14c656 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:23.282620 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-23180c1d-8e1f-4671-bc95-321ead14c656 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:23.435153 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-23180c1d-8e1f-4671-bc95-321ead14c656 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:23.444118 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-23180c1d-8e1f-4671-bc95-321ead14c656 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:23.449524 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-23180c1d-8e1f-4671-bc95-321ead14c656 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:23.451351 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-23180c1d-8e1f-4671-bc95-321ead14c656 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1736 microversion: 2.20 time: 0.186668 May 19 15:11:23.455860 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 325/647] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:23 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:24.151161 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-03b9aed9-51fa-4290-b7bc-aa3613783919 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:24.151983 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-03b9aed9-51fa-4290-b7bc-aa3613783919 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:24.159005 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-03b9aed9-51fa-4290-b7bc-aa3613783919 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:24.159489 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-03b9aed9-51fa-4290-b7bc-aa3613783919 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:24.160261 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-03b9aed9-51fa-4290-b7bc-aa3613783919 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:24.160701 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-03b9aed9-51fa-4290-b7bc-aa3613783919 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:24.325487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-03b9aed9-51fa-4290-b7bc-aa3613783919 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:24.338151 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-03b9aed9-51fa-4290-b7bc-aa3613783919 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1266 microversion: 2.1 time: 0.192836 May 19 15:11:24.339004 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 323/648] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:24 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:24.475640 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7546c5d3-d4b5-4529-a791-18f74ac5e75e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:24.476229 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7546c5d3-d4b5-4529-a791-18f74ac5e75e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:24.482893 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7546c5d3-d4b5-4529-a791-18f74ac5e75e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:24.483671 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7546c5d3-d4b5-4529-a791-18f74ac5e75e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:24.484687 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7546c5d3-d4b5-4529-a791-18f74ac5e75e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:24.485351 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7546c5d3-d4b5-4529-a791-18f74ac5e75e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:24.635048 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7546c5d3-d4b5-4529-a791-18f74ac5e75e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:24.637895 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:24.645977 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7546c5d3-d4b5-4529-a791-18f74ac5e75e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:24.647775 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7546c5d3-d4b5-4529-a791-18f74ac5e75e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:24.649042 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7546c5d3-d4b5-4529-a791-18f74ac5e75e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1736 microversion: 2.20 time: 0.177416 May 19 15:11:24.649634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 326/649] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:24 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:11:25.355422 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7b1da4db-dd3d-47b8-87c5-db1bae10a018 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:25.356056 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7b1da4db-dd3d-47b8-87c5-db1bae10a018 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:25.357919 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=2 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:25.377142 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7b1da4db-dd3d-47b8-87c5-db1bae10a018 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:25.377506 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7b1da4db-dd3d-47b8-87c5-db1bae10a018 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:25.378293 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7b1da4db-dd3d-47b8-87c5-db1bae10a018 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:25.378728 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7b1da4db-dd3d-47b8-87c5-db1bae10a018 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:25.552978 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7b1da4db-dd3d-47b8-87c5-db1bae10a018 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:25.561117 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7b1da4db-dd3d-47b8-87c5-db1bae10a018 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1266 microversion: 2.1 time: 0.209596 May 19 15:11:25.570834 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 324/650] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:25 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:25.667585 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-687e5d5b-ac66-4ccc-82d1-d54276fc1ca4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:25.669036 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-687e5d5b-ac66-4ccc-82d1-d54276fc1ca4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:25.672829 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:25.677993 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-687e5d5b-ac66-4ccc-82d1-d54276fc1ca4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:25.678448 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-687e5d5b-ac66-4ccc-82d1-d54276fc1ca4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:25.679384 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-687e5d5b-ac66-4ccc-82d1-d54276fc1ca4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:25.679819 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-687e5d5b-ac66-4ccc-82d1-d54276fc1ca4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:25.822815 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-687e5d5b-ac66-4ccc-82d1-d54276fc1ca4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:25.832271 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-687e5d5b-ac66-4ccc-82d1-d54276fc1ca4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:25.834406 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-687e5d5b-ac66-4ccc-82d1-d54276fc1ca4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:25.835718 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-687e5d5b-ac66-4ccc-82d1-d54276fc1ca4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1736 microversion: 2.20 time: 0.172202 May 19 15:11:25.846228 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 327/651] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:25 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:26.577922 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7c007729-344b-46b1-ab79-8ec632b9d4e7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:26.579320 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7c007729-344b-46b1-ab79-8ec632b9d4e7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:26.586765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7c007729-344b-46b1-ab79-8ec632b9d4e7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:26.587344 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7c007729-344b-46b1-ab79-8ec632b9d4e7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:26.588174 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7c007729-344b-46b1-ab79-8ec632b9d4e7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:26.590877 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7c007729-344b-46b1-ab79-8ec632b9d4e7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:26.749868 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7c007729-344b-46b1-ab79-8ec632b9d4e7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:26.757709 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7c007729-344b-46b1-ab79-8ec632b9d4e7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1266 microversion: 2.1 time: 0.183604 May 19 15:11:26.760461 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 325/652] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:26 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:26.856055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7498759b-810d-4e51-b6ff-c9ec3a58794e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:26.856579 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7498759b-810d-4e51-b6ff-c9ec3a58794e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:26.858817 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:26.863724 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7498759b-810d-4e51-b6ff-c9ec3a58794e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:26.864207 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7498759b-810d-4e51-b6ff-c9ec3a58794e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:26.864980 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7498759b-810d-4e51-b6ff-c9ec3a58794e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:26.865409 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7498759b-810d-4e51-b6ff-c9ec3a58794e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:27.013353 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7498759b-810d-4e51-b6ff-c9ec3a58794e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:27.024998 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7498759b-810d-4e51-b6ff-c9ec3a58794e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:27.028043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7498759b-810d-4e51-b6ff-c9ec3a58794e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:27.030038 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7498759b-810d-4e51-b6ff-c9ec3a58794e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1736 microversion: 2.20 time: 0.177961 May 19 15:11:27.033295 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 328/653] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:26 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:27.510814 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-0eec0649-b6f6-4d63-aaec-2a71ad7f0547 req-f10655c1-3d72-4b77-9432-23f21ea9044f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0116d16f-6546-42a0-8274-22fc3577000b", "name": "network-vif-plugged", "status": "completed", "tag": "a9f91331-2ea7-4396-8799-ffc363f22091"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:27.519283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-0eec0649-b6f6-4d63-aaec-2a71ad7f0547 req-f10655c1-3d72-4b77-9432-23f21ea9044f service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:27.519869 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-0eec0649-b6f6-4d63-aaec-2a71ad7f0547 req-f10655c1-3d72-4b77-9432-23f21ea9044f service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:27.525311 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:27.538556 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-0eec0649-b6f6-4d63-aaec-2a71ad7f0547 req-f10655c1-3d72-4b77-9432-23f21ea9044f service nova] Creating event network-vif-plugged:a9f91331-2ea7-4396-8799-ffc363f22091 for instance 0116d16f-6546-42a0-8274-22fc3577000b on hv-cinder-82549 May 19 15:11:27.557664 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-0eec0649-b6f6-4d63-aaec-2a71ad7f0547 req-f10655c1-3d72-4b77-9432-23f21ea9044f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047109 May 19 15:11:27.557664 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 326/654] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:11:27.777648 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fa2f243b-ea35-484c-8843-e3c0b8407cf6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:27.778276 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fa2f243b-ea35-484c-8843-e3c0b8407cf6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:27.787397 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fa2f243b-ea35-484c-8843-e3c0b8407cf6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:27.787968 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fa2f243b-ea35-484c-8843-e3c0b8407cf6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:27.788870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fa2f243b-ea35-484c-8843-e3c0b8407cf6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:27.789399 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fa2f243b-ea35-484c-8843-e3c0b8407cf6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:27.959706 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fa2f243b-ea35-484c-8843-e3c0b8407cf6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:27.968904 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fa2f243b-ea35-484c-8843-e3c0b8407cf6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1266 microversion: 2.1 time: 0.195564 May 19 15:11:27.969561 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 329/655] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:27 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:28.054076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e35aebdf-0b86-4361-a5ff-5dffae6fa21a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:28.055399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e35aebdf-0b86-4361-a5ff-5dffae6fa21a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:28.062558 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e35aebdf-0b86-4361-a5ff-5dffae6fa21a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:28.063156 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e35aebdf-0b86-4361-a5ff-5dffae6fa21a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:28.063969 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e35aebdf-0b86-4361-a5ff-5dffae6fa21a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:28.064414 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e35aebdf-0b86-4361-a5ff-5dffae6fa21a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:28.204637 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e35aebdf-0b86-4361-a5ff-5dffae6fa21a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:28.213625 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e35aebdf-0b86-4361-a5ff-5dffae6fa21a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:28.215123 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e35aebdf-0b86-4361-a5ff-5dffae6fa21a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:28.216417 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e35aebdf-0b86-4361-a5ff-5dffae6fa21a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1736 microversion: 2.20 time: 0.168243 May 19 15:11:28.217000 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 327/656] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:28 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:28.985966 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b1b6ec42-9677-4c4c-81ee-6dacba9d1f6c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:28.986580 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b1b6ec42-9677-4c4c-81ee-6dacba9d1f6c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:28.993306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b1b6ec42-9677-4c4c-81ee-6dacba9d1f6c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:28.993764 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b1b6ec42-9677-4c4c-81ee-6dacba9d1f6c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:28.994529 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b1b6ec42-9677-4c4c-81ee-6dacba9d1f6c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:28.994967 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b1b6ec42-9677-4c4c-81ee-6dacba9d1f6c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:29.126026 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b1b6ec42-9677-4c4c-81ee-6dacba9d1f6c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:29.134033 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b1b6ec42-9677-4c4c-81ee-6dacba9d1f6c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1266 microversion: 2.1 time: 0.151955 May 19 15:11:29.134646 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 330/657] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:28 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:29.235443 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e6b405f0-af8c-43f4-9f3f-b4e3a0a1ee82 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:29.236439 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e6b405f0-af8c-43f4-9f3f-b4e3a0a1ee82 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:29.242887 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e6b405f0-af8c-43f4-9f3f-b4e3a0a1ee82 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:29.243642 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e6b405f0-af8c-43f4-9f3f-b4e3a0a1ee82 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:29.244400 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e6b405f0-af8c-43f4-9f3f-b4e3a0a1ee82 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:29.245427 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e6b405f0-af8c-43f4-9f3f-b4e3a0a1ee82 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:29.378207 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e6b405f0-af8c-43f4-9f3f-b4e3a0a1ee82 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:29.389350 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e6b405f0-af8c-43f4-9f3f-b4e3a0a1ee82 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:29.391018 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e6b405f0-af8c-43f4-9f3f-b4e3a0a1ee82 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:29.392252 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e6b405f0-af8c-43f4-9f3f-b4e3a0a1ee82 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1718 microversion: 2.20 time: 0.161125 May 19 15:11:29.392819 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 328/658] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:29 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:30.150449 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6633110b-9500-46ca-9dac-856366134493 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:30.151171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6633110b-9500-46ca-9dac-856366134493 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:30.157595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6633110b-9500-46ca-9dac-856366134493 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:30.158057 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6633110b-9500-46ca-9dac-856366134493 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:30.158827 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6633110b-9500-46ca-9dac-856366134493 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:30.159314 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6633110b-9500-46ca-9dac-856366134493 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:30.410175 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7e1c1cc4-62ae-4c6b-ad92-d7db95f649e9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:30.410955 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7e1c1cc4-62ae-4c6b-ad92-d7db95f649e9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:30.417834 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7e1c1cc4-62ae-4c6b-ad92-d7db95f649e9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:30.418294 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7e1c1cc4-62ae-4c6b-ad92-d7db95f649e9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:30.419078 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7e1c1cc4-62ae-4c6b-ad92-d7db95f649e9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:30.419551 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7e1c1cc4-62ae-4c6b-ad92-d7db95f649e9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:30.550514 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6633110b-9500-46ca-9dac-856366134493 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:30.558737 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6633110b-9500-46ca-9dac-856366134493 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1452 microversion: 2.1 time: 0.412174 May 19 15:11:30.559331 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 331/659] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:30 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1452 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:30.575530 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a8a66cd9-1d52-4338-a7b2-0af0df1ccf8f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:30.576151 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a8a66cd9-1d52-4338-a7b2-0af0df1ccf8f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:30.582216 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a8a66cd9-1d52-4338-a7b2-0af0df1ccf8f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:30.582681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a8a66cd9-1d52-4338-a7b2-0af0df1ccf8f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:30.583486 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a8a66cd9-1d52-4338-a7b2-0af0df1ccf8f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:30.583945 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a8a66cd9-1d52-4338-a7b2-0af0df1ccf8f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:30.594390 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7e1c1cc4-62ae-4c6b-ad92-d7db95f649e9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:30.602747 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7e1c1cc4-62ae-4c6b-ad92-d7db95f649e9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:30.604281 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7e1c1cc4-62ae-4c6b-ad92-d7db95f649e9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:30.605483 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7e1c1cc4-62ae-4c6b-ad92-d7db95f649e9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1718 microversion: 2.20 time: 0.199349 May 19 15:11:30.606064 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 329/660] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:30 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1718 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:11:30.717572 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a8a66cd9-1d52-4338-a7b2-0af0df1ccf8f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:30.725483 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a8a66cd9-1d52-4338-a7b2-0af0df1ccf8f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1452 microversion: 2.1 time: 0.153715 May 19 15:11:30.726052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 332/661] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:30 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:11:31.624748 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f6a2f5f9-2046-467d-86ed-209a6db213d7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:31.626392 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f6a2f5f9-2046-467d-86ed-209a6db213d7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:31.633166 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f6a2f5f9-2046-467d-86ed-209a6db213d7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:31.633616 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f6a2f5f9-2046-467d-86ed-209a6db213d7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:31.634388 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f6a2f5f9-2046-467d-86ed-209a6db213d7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:31.634824 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f6a2f5f9-2046-467d-86ed-209a6db213d7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:31.847280 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f6a2f5f9-2046-467d-86ed-209a6db213d7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:31.856706 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f6a2f5f9-2046-467d-86ed-209a6db213d7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:31.858215 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f6a2f5f9-2046-467d-86ed-209a6db213d7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:31.859421 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f6a2f5f9-2046-467d-86ed-209a6db213d7 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1718 microversion: 2.20 time: 0.238780 May 19 15:11:31.859999 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 330/662] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:31 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1718 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:32.441017 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-b0e8e143-fe9f-43d7-8320-5846b07d36a1 req-9fd8e3a7-3cc3-4818-9737-ba53039bdac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0116d16f-6546-42a0-8274-22fc3577000b", "tag": "a9f91331-2ea7-4396-8799-ffc363f22091"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:32.449889 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-b0e8e143-fe9f-43d7-8320-5846b07d36a1 req-9fd8e3a7-3cc3-4818-9737-ba53039bdac2 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:32.450345 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-b0e8e143-fe9f-43d7-8320-5846b07d36a1 req-9fd8e3a7-3cc3-4818-9737-ba53039bdac2 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:32.463555 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-b0e8e143-fe9f-43d7-8320-5846b07d36a1 req-9fd8e3a7-3cc3-4818-9737-ba53039bdac2 service nova] Creating event network-changed:a9f91331-2ea7-4396-8799-ffc363f22091 for instance 0116d16f-6546-42a0-8274-22fc3577000b on hv-cinder-82549 May 19 15:11:32.467087 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-b0e8e143-fe9f-43d7-8320-5846b07d36a1 req-9fd8e3a7-3cc3-4818-9737-ba53039bdac2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029891 May 19 15:11:32.467803 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 333/663] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:11:32.878096 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7a4bd213-ad14-42a7-873f-fe667c0e3a5b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:32.878718 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7a4bd213-ad14-42a7-873f-fe667c0e3a5b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:32.886300 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a4bd213-ad14-42a7-873f-fe667c0e3a5b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:32.886754 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a4bd213-ad14-42a7-873f-fe667c0e3a5b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:32.887571 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a4bd213-ad14-42a7-873f-fe667c0e3a5b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:32.888011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a4bd213-ad14-42a7-873f-fe667c0e3a5b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:33.031371 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7a4bd213-ad14-42a7-873f-fe667c0e3a5b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:33.040202 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7a4bd213-ad14-42a7-873f-fe667c0e3a5b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:33.042894 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7a4bd213-ad14-42a7-873f-fe667c0e3a5b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:33.044189 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7a4bd213-ad14-42a7-873f-fe667c0e3a5b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1661 microversion: 2.20 time: 0.170072 May 19 15:11:33.044883 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 331/664] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:32 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1661 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:33.065266 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e7666bf3-f7ca-4718-863d-89d94fbc1abb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebd62c32-2b83-4945-9d50-ed5ad5735467"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:33.067607 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e7666bf3-f7ca-4718-863d-89d94fbc1abb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:33.073977 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7666bf3-f7ca-4718-863d-89d94fbc1abb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:33.074441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7666bf3-f7ca-4718-863d-89d94fbc1abb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:33.075250 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7666bf3-f7ca-4718-863d-89d94fbc1abb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:33.075710 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e7666bf3-f7ca-4718-863d-89d94fbc1abb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:33.408389 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e7666bf3-f7ca-4718-863d-89d94fbc1abb tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "POST /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.347792 May 19 15:11:33.409367 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 334/665] 10.222.0.24 () {62 vars in 1363 bytes} [Thu May 19 15:11:33 2022] POST /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f/os-volume_attachments => generated 188 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 15:11:33.555519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-96513ca4-a684-4536-b5ae-3af468fab063 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:33.556268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-96513ca4-a684-4536-b5ae-3af468fab063 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:33.562775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-96513ca4-a684-4536-b5ae-3af468fab063 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:33.563664 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-96513ca4-a684-4536-b5ae-3af468fab063 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:33.564595 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-96513ca4-a684-4536-b5ae-3af468fab063 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:33.565194 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-96513ca4-a684-4536-b5ae-3af468fab063 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:33.580840 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-c652d433-921f-4efe-a223-f1ee49080f6f req-872974f5-f6bf-4468-9996-7e9853893d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7516d806-e895-4839-8142-5209040d1f2f", "name": "network-vif-unplugged", "status": "completed", "tag": "31aad5e7-16b4-45c8-b12a-2912bed903a1"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:33.610873 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-c652d433-921f-4efe-a223-f1ee49080f6f req-872974f5-f6bf-4468-9996-7e9853893d54 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:33.612932 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-c652d433-921f-4efe-a223-f1ee49080f6f req-872974f5-f6bf-4468-9996-7e9853893d54 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:33.628778 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.compute.server_external_events [req-c652d433-921f-4efe-a223-f1ee49080f6f req-872974f5-f6bf-4468-9996-7e9853893d54 service nova] Unable to find a host for instance 7516d806-e895-4839-8142-5209040d1f2f. Dropping event network-vif-unplugged {{(pid=117444) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 15:11:33.629744 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-c652d433-921f-4efe-a223-f1ee49080f6f req-872974f5-f6bf-4468-9996-7e9853893d54 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.054213 May 19 15:11:33.630885 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 335/666] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 56 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 19 15:11:33.823281 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-96513ca4-a684-4536-b5ae-3af468fab063 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f/os-volume_attachments/ebd62c32-2b83-4945-9d50-ed5ad5735467" status: 202 len: 0 microversion: 2.20 time: 0.272107 May 19 15:11:33.823881 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 332/667] 10.222.0.24 () {60 vars in 1456 bytes} [Thu May 19 15:11:33 2022] DELETE /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f/os-volume_attachments/ebd62c32-2b83-4945-9d50-ed5ad5735467 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 15:11:33.879066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5e06c002-c3d4-45e5-874b-64319a92426b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:33.879702 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5e06c002-c3d4-45e5-874b-64319a92426b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:33.886841 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5e06c002-c3d4-45e5-874b-64319a92426b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:33.887335 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5e06c002-c3d4-45e5-874b-64319a92426b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:33.888109 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5e06c002-c3d4-45e5-874b-64319a92426b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:33.888550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5e06c002-c3d4-45e5-874b-64319a92426b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:33.892387 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:33.967679 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5e06c002-c3d4-45e5-874b-64319a92426b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "POST /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f/action" status: 202 len: 0 microversion: 2.20 time: 0.092382 May 19 15:11:33.968288 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 336/668] 10.222.0.24 () {62 vars in 1318 bytes} [Thu May 19 15:11:33 2022] POST /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 15:11:33.976915 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-512c1605-e969-4f1e-a9e5-d7ac1035043b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:33.977550 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-512c1605-e969-4f1e-a9e5-d7ac1035043b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:33.987117 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-512c1605-e969-4f1e-a9e5-d7ac1035043b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:33.987713 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-512c1605-e969-4f1e-a9e5-d7ac1035043b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:33.988478 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-512c1605-e969-4f1e-a9e5-d7ac1035043b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:33.988934 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-512c1605-e969-4f1e-a9e5-d7ac1035043b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:34.118746 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-512c1605-e969-4f1e-a9e5-d7ac1035043b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:34.126826 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-512c1605-e969-4f1e-a9e5-d7ac1035043b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:34.128436 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-512c1605-e969-4f1e-a9e5-d7ac1035043b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:34.129757 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-512c1605-e969-4f1e-a9e5-d7ac1035043b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1669 microversion: 2.20 time: 0.157230 May 19 15:11:34.130316 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 333/669] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:33 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:35.148033 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-44edd7ff-75cd-4f4a-961c-614e68f53b2b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:35.148595 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-44edd7ff-75cd-4f4a-961c-614e68f53b2b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:35.155101 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-44edd7ff-75cd-4f4a-961c-614e68f53b2b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:35.155600 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-44edd7ff-75cd-4f4a-961c-614e68f53b2b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:35.156376 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-44edd7ff-75cd-4f4a-961c-614e68f53b2b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:35.156821 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-44edd7ff-75cd-4f4a-961c-614e68f53b2b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:35.287472 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-44edd7ff-75cd-4f4a-961c-614e68f53b2b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:35.296265 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-44edd7ff-75cd-4f4a-961c-614e68f53b2b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:35.297754 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-44edd7ff-75cd-4f4a-961c-614e68f53b2b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:35.299424 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-44edd7ff-75cd-4f4a-961c-614e68f53b2b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1727 microversion: 2.20 time: 0.155404 May 19 15:11:35.300178 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 337/670] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:35 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:36.337372 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6c4e78c7-e5b6-4bda-825f-d0d0477e8d98 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:36.339739 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-6c4e78c7-e5b6-4bda-825f-d0d0477e8d98 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:36.353210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6c4e78c7-e5b6-4bda-825f-d0d0477e8d98 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:36.354209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6c4e78c7-e5b6-4bda-825f-d0d0477e8d98 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:36.355687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6c4e78c7-e5b6-4bda-825f-d0d0477e8d98 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:36.356554 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6c4e78c7-e5b6-4bda-825f-d0d0477e8d98 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:36.512362 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6c4e78c7-e5b6-4bda-825f-d0d0477e8d98 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:36.520399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6c4e78c7-e5b6-4bda-825f-d0d0477e8d98 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:36.521936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6c4e78c7-e5b6-4bda-825f-d0d0477e8d98 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:36.523096 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6c4e78c7-e5b6-4bda-825f-d0d0477e8d98 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1727 microversion: 2.20 time: 0.194728 May 19 15:11:36.523678 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 334/671] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:36 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1727 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:37.541604 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e0bbb451-a0dc-4e65-ad81-e93d81557bae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:37.542822 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e0bbb451-a0dc-4e65-ad81-e93d81557bae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:37.549616 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e0bbb451-a0dc-4e65-ad81-e93d81557bae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:37.550068 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e0bbb451-a0dc-4e65-ad81-e93d81557bae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:37.550831 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e0bbb451-a0dc-4e65-ad81-e93d81557bae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:37.551485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e0bbb451-a0dc-4e65-ad81-e93d81557bae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:37.689228 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e0bbb451-a0dc-4e65-ad81-e93d81557bae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:37.698010 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e0bbb451-a0dc-4e65-ad81-e93d81557bae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:37.699541 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e0bbb451-a0dc-4e65-ad81-e93d81557bae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:37.700858 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e0bbb451-a0dc-4e65-ad81-e93d81557bae tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1727 microversion: 2.20 time: 0.163657 May 19 15:11:37.701482 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 338/672] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:37 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:11:38.720584 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f3cb758f-f728-469d-b225-ede961649a43 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:38.721796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f3cb758f-f728-469d-b225-ede961649a43 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:38.730086 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f3cb758f-f728-469d-b225-ede961649a43 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:38.730766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f3cb758f-f728-469d-b225-ede961649a43 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:38.731636 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f3cb758f-f728-469d-b225-ede961649a43 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:38.732088 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f3cb758f-f728-469d-b225-ede961649a43 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:38.868262 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f3cb758f-f728-469d-b225-ede961649a43 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:38.878503 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f3cb758f-f728-469d-b225-ede961649a43 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:38.880572 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f3cb758f-f728-469d-b225-ede961649a43 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:38.881760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f3cb758f-f728-469d-b225-ede961649a43 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1727 microversion: 2.20 time: 0.166545 May 19 15:11:38.882330 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 335/673] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:38 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:39.900276 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4cc05d98-1f2e-4a47-92a2-446c62d16641 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:39.900961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4cc05d98-1f2e-4a47-92a2-446c62d16641 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:39.907832 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cc05d98-1f2e-4a47-92a2-446c62d16641 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:39.908456 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cc05d98-1f2e-4a47-92a2-446c62d16641 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:39.909106 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cc05d98-1f2e-4a47-92a2-446c62d16641 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:39.909610 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4cc05d98-1f2e-4a47-92a2-446c62d16641 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:40.079502 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4cc05d98-1f2e-4a47-92a2-446c62d16641 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:40.090614 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4cc05d98-1f2e-4a47-92a2-446c62d16641 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:40.092267 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4cc05d98-1f2e-4a47-92a2-446c62d16641 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:40.093846 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4cc05d98-1f2e-4a47-92a2-446c62d16641 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1727 microversion: 2.20 time: 0.197820 May 19 15:11:40.094528 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 339/674] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:39 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:41.112741 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c74dd833-8715-44aa-a0fd-fc33407af50a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:41.114561 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c74dd833-8715-44aa-a0fd-fc33407af50a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:41.120735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c74dd833-8715-44aa-a0fd-fc33407af50a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:41.121194 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c74dd833-8715-44aa-a0fd-fc33407af50a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:41.121965 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c74dd833-8715-44aa-a0fd-fc33407af50a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:41.122404 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c74dd833-8715-44aa-a0fd-fc33407af50a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:41.253642 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c74dd833-8715-44aa-a0fd-fc33407af50a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:41.262337 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c74dd833-8715-44aa-a0fd-fc33407af50a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:41.264081 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c74dd833-8715-44aa-a0fd-fc33407af50a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:41.265377 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c74dd833-8715-44aa-a0fd-fc33407af50a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1727 microversion: 2.20 time: 0.156736 May 19 15:11:41.266100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 336/675] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:41 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:42.284704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-540c1dec-04cb-409b-8f57-fcb602bd3155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:42.285375 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-540c1dec-04cb-409b-8f57-fcb602bd3155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:42.293035 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-540c1dec-04cb-409b-8f57-fcb602bd3155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:42.293579 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-540c1dec-04cb-409b-8f57-fcb602bd3155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:42.294462 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-540c1dec-04cb-409b-8f57-fcb602bd3155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:42.294970 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-540c1dec-04cb-409b-8f57-fcb602bd3155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:42.437976 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-540c1dec-04cb-409b-8f57-fcb602bd3155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:42.446296 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-540c1dec-04cb-409b-8f57-fcb602bd3155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:42.447836 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-540c1dec-04cb-409b-8f57-fcb602bd3155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:42.449166 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-540c1dec-04cb-409b-8f57-fcb602bd3155 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1727 microversion: 2.20 time: 0.168683 May 19 15:11:42.449767 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 340/676] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:42 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:11:43.468976 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e097be03-35dd-4894-972d-baa388dc1d16 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:43.470238 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e097be03-35dd-4894-972d-baa388dc1d16 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:43.477499 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e097be03-35dd-4894-972d-baa388dc1d16 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:43.478723 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e097be03-35dd-4894-972d-baa388dc1d16 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:43.478723 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e097be03-35dd-4894-972d-baa388dc1d16 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:43.479091 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e097be03-35dd-4894-972d-baa388dc1d16 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:43.623529 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e097be03-35dd-4894-972d-baa388dc1d16 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:43.632508 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e097be03-35dd-4894-972d-baa388dc1d16 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:43.634005 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e097be03-35dd-4894-972d-baa388dc1d16 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:43.635170 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e097be03-35dd-4894-972d-baa388dc1d16 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1727 microversion: 2.20 time: 0.170234 May 19 15:11:43.635771 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 337/677] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:43 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:11:43.891189 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ddb95843-aa89-45b2-88d8-1bf2a944facc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:43.891812 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ddb95843-aa89-45b2-88d8-1bf2a944facc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:43.898512 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ddb95843-aa89-45b2-88d8-1bf2a944facc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:43.898973 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ddb95843-aa89-45b2-88d8-1bf2a944facc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:43.899779 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ddb95843-aa89-45b2-88d8-1bf2a944facc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:43.900226 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ddb95843-aa89-45b2-88d8-1bf2a944facc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:43.926853 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ddb95843-aa89-45b2-88d8-1bf2a944facc tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c/ips" status: 200 len: 147 microversion: 2.1 time: 0.039525 May 19 15:11:43.928290 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 341/678] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 15:11:43 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:11:44.652493 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-dfff0588-d7ba-49ff-840a-a3c51ce3034f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:44.653186 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-dfff0588-d7ba-49ff-840a-a3c51ce3034f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:44.659898 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-dfff0588-d7ba-49ff-840a-a3c51ce3034f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:44.660334 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-dfff0588-d7ba-49ff-840a-a3c51ce3034f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:44.661098 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-dfff0588-d7ba-49ff-840a-a3c51ce3034f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:44.661526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-dfff0588-d7ba-49ff-840a-a3c51ce3034f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:44.795111 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-dfff0588-d7ba-49ff-840a-a3c51ce3034f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:44.803873 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-dfff0588-d7ba-49ff-840a-a3c51ce3034f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:44.805371 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-dfff0588-d7ba-49ff-840a-a3c51ce3034f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:44.806529 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-dfff0588-d7ba-49ff-840a-a3c51ce3034f tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1727 microversion: 2.20 time: 0.157919 May 19 15:11:44.807119 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 338/679] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:44 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:45.269160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-43ae4577-eb97-4881-9419-54e7c5f94881 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d907dd71-1193-459d-9693-0b494f4a6787"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:45.270291 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-43ae4577-eb97-4881-9419-54e7c5f94881 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:45.277246 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-43ae4577-eb97-4881-9419-54e7c5f94881 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:45.277710 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-43ae4577-eb97-4881-9419-54e7c5f94881 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:45.278471 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-43ae4577-eb97-4881-9419-54e7c5f94881 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:45.278909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-43ae4577-eb97-4881-9419-54e7c5f94881 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:45.825481 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-60ab67e3-a560-473a-b47c-85d159ad7ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:45.826216 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-60ab67e3-a560-473a-b47c-85d159ad7ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:45.833921 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-60ab67e3-a560-473a-b47c-85d159ad7ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:45.834376 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-60ab67e3-a560-473a-b47c-85d159ad7ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:45.835257 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-60ab67e3-a560-473a-b47c-85d159ad7ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:45.835701 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-60ab67e3-a560-473a-b47c-85d159ad7ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:45.885881 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-43ae4577-eb97-4881-9419-54e7c5f94881 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "POST /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.620138 May 19 15:11:45.891088 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 342/680] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 15:11:45 2022] POST /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c/os-volume_attachments => generated 194 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:11:45.974081 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-60ab67e3-a560-473a-b47c-85d159ad7ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:45.981965 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-60ab67e3-a560-473a-b47c-85d159ad7ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:45.983486 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-60ab67e3-a560-473a-b47c-85d159ad7ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:45.984630 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-60ab67e3-a560-473a-b47c-85d159ad7ef8 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1727 microversion: 2.20 time: 0.163830 May 19 15:11:45.985187 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 339/681] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:45 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:47.004696 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a4531aae-57af-4287-963c-fdab13c1a40e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:47.006113 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a4531aae-57af-4287-963c-fdab13c1a40e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:47.013534 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4531aae-57af-4287-963c-fdab13c1a40e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:47.013993 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4531aae-57af-4287-963c-fdab13c1a40e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:47.014776 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4531aae-57af-4287-963c-fdab13c1a40e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:47.015233 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a4531aae-57af-4287-963c-fdab13c1a40e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:47.142791 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a4531aae-57af-4287-963c-fdab13c1a40e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:47.151269 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a4531aae-57af-4287-963c-fdab13c1a40e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:47.152792 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a4531aae-57af-4287-963c-fdab13c1a40e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:47.153941 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a4531aae-57af-4287-963c-fdab13c1a40e tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1727 microversion: 2.20 time: 0.154242 May 19 15:11:47.154501 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 343/682] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:46 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:48.172786 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-007812f3-3d7a-4cc2-9be0-46855ba1d367 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:48.173389 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-007812f3-3d7a-4cc2-9be0-46855ba1d367 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:48.179986 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-007812f3-3d7a-4cc2-9be0-46855ba1d367 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:48.180431 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-007812f3-3d7a-4cc2-9be0-46855ba1d367 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:48.181183 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-007812f3-3d7a-4cc2-9be0-46855ba1d367 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:48.181614 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-007812f3-3d7a-4cc2-9be0-46855ba1d367 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:48.484134 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-007812f3-3d7a-4cc2-9be0-46855ba1d367 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:48.492106 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-007812f3-3d7a-4cc2-9be0-46855ba1d367 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:48.493919 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-007812f3-3d7a-4cc2-9be0-46855ba1d367 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:48.495078 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-007812f3-3d7a-4cc2-9be0-46855ba1d367 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1727 microversion: 2.20 time: 0.326091 May 19 15:11:48.495677 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 340/683] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:48 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1727 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:49.513719 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1e749831-700b-4078-9fe7-6aea778a9448 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:49.514339 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1e749831-700b-4078-9fe7-6aea778a9448 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:49.520830 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1e749831-700b-4078-9fe7-6aea778a9448 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:49.521284 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1e749831-700b-4078-9fe7-6aea778a9448 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:49.522052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1e749831-700b-4078-9fe7-6aea778a9448 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:49.522492 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1e749831-700b-4078-9fe7-6aea778a9448 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:49.596107 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-9eae9c50-d1d4-46aa-bed5-c10208a27170 req-2277319b-e1b7-4961-af0b-acc533ede7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7516d806-e895-4839-8142-5209040d1f2f", "name": "network-vif-plugged", "status": "completed", "tag": "31aad5e7-16b4-45c8-b12a-2912bed903a1"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:49.607166 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-9eae9c50-d1d4-46aa-bed5-c10208a27170 req-2277319b-e1b7-4961-af0b-acc533ede7ef service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:49.607719 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-9eae9c50-d1d4-46aa-bed5-c10208a27170 req-2277319b-e1b7-4961-af0b-acc533ede7ef service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:49.613105 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:49.622724 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-9eae9c50-d1d4-46aa-bed5-c10208a27170 req-2277319b-e1b7-4961-af0b-acc533ede7ef service nova] Creating event network-vif-plugged:31aad5e7-16b4-45c8-b12a-2912bed903a1 for instance 7516d806-e895-4839-8142-5209040d1f2f on hv-cinder-82549 May 19 15:11:49.628083 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-9eae9c50-d1d4-46aa-bed5-c10208a27170 req-2277319b-e1b7-4961-af0b-acc533ede7ef service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035610 May 19 15:11:49.629197 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 341/684] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:11:49.658417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1e749831-700b-4078-9fe7-6aea778a9448 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:49.667307 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1e749831-700b-4078-9fe7-6aea778a9448 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:49.668821 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1e749831-700b-4078-9fe7-6aea778a9448 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:49.669995 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1e749831-700b-4078-9fe7-6aea778a9448 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1727 microversion: 2.20 time: 0.160277 May 19 15:11:49.673318 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 344/685] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:49 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:50.689538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-01b91ed8-24bf-4152-9e39-cce6b280d248 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:50.690236 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-01b91ed8-24bf-4152-9e39-cce6b280d248 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:50.698098 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-01b91ed8-24bf-4152-9e39-cce6b280d248 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:50.698603 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-01b91ed8-24bf-4152-9e39-cce6b280d248 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:50.699508 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-01b91ed8-24bf-4152-9e39-cce6b280d248 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:50.699950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-01b91ed8-24bf-4152-9e39-cce6b280d248 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:50.826102 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-01b91ed8-24bf-4152-9e39-cce6b280d248 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:50.834116 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-01b91ed8-24bf-4152-9e39-cce6b280d248 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:50.835649 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-01b91ed8-24bf-4152-9e39-cce6b280d248 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:50.836807 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-01b91ed8-24bf-4152-9e39-cce6b280d248 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1727 microversion: 2.20 time: 0.152585 May 19 15:11:50.837357 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 342/686] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:50 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:51.853774 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c77e8c96-b640-4d11-8c43-77308cee29a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:51.854432 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c77e8c96-b640-4d11-8c43-77308cee29a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:51.861204 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c77e8c96-b640-4d11-8c43-77308cee29a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:51.861684 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c77e8c96-b640-4d11-8c43-77308cee29a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:51.862585 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c77e8c96-b640-4d11-8c43-77308cee29a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:51.863034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c77e8c96-b640-4d11-8c43-77308cee29a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:51.999749 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c77e8c96-b640-4d11-8c43-77308cee29a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:52.008431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c77e8c96-b640-4d11-8c43-77308cee29a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:52.009926 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c77e8c96-b640-4d11-8c43-77308cee29a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:52.011086 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c77e8c96-b640-4d11-8c43-77308cee29a0 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1727 microversion: 2.20 time: 0.161216 May 19 15:11:52.011699 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 345/687] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:51 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:53.029239 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9fbee7d5-972a-4be9-aa4c-f8a1d1543d74 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:53.029856 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-9fbee7d5-972a-4be9-aa4c-f8a1d1543d74 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:53.032374 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=42 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:53.037689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9fbee7d5-972a-4be9-aa4c-f8a1d1543d74 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:53.038144 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9fbee7d5-972a-4be9-aa4c-f8a1d1543d74 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:53.038913 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9fbee7d5-972a-4be9-aa4c-f8a1d1543d74 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:53.039390 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9fbee7d5-972a-4be9-aa4c-f8a1d1543d74 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:53.167346 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9fbee7d5-972a-4be9-aa4c-f8a1d1543d74 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:53.176597 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9fbee7d5-972a-4be9-aa4c-f8a1d1543d74 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:53.178116 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9fbee7d5-972a-4be9-aa4c-f8a1d1543d74 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:53.179351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9fbee7d5-972a-4be9-aa4c-f8a1d1543d74 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1714 microversion: 2.20 time: 0.153996 May 19 15:11:53.179915 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 343/688] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:11:53 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:11:53.478623 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ba739d03-0bd0-4253-91d8-eb23357b2c91 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:53.479124 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ba739d03-0bd0-4253-91d8-eb23357b2c91 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:53.485582 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ba739d03-0bd0-4253-91d8-eb23357b2c91 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:53.486036 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ba739d03-0bd0-4253-91d8-eb23357b2c91 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:53.486804 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ba739d03-0bd0-4253-91d8-eb23357b2c91 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:53.487265 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ba739d03-0bd0-4253-91d8-eb23357b2c91 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:53.567952 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-ba739d03-0bd0-4253-91d8-eb23357b2c91 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lazy-loading 'services' on Instance uuid 1a263534-d906-4c7d-9b25-88e0aca68b0c {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:11:53.639813 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ba739d03-0bd0-4253-91d8-eb23357b2c91 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "DELETE /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c/os-volume_attachments/d907dd71-1193-459d-9693-0b494f4a6787" status: 202 len: 0 microversion: 2.1 time: 0.164888 May 19 15:11:53.640431 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 346/689] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 15:11:53 2022] DELETE /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c/os-volume_attachments/d907dd71-1193-459d-9693-0b494f4a6787 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:11:53.650086 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-8bb3a256-d363-46c3-bb33-f08c44595890 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:53.651315 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-8bb3a256-d363-46c3-bb33-f08c44595890 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:53.657359 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8bb3a256-d363-46c3-bb33-f08c44595890 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:53.657809 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8bb3a256-d363-46c3-bb33-f08c44595890 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:53.658574 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8bb3a256-d363-46c3-bb33-f08c44595890 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:53.659008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8bb3a256-d363-46c3-bb33-f08c44595890 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:53.690375 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-8bb3a256-d363-46c3-bb33-f08c44595890 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045417 May 19 15:11:53.690924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 344/690] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:11:53 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:11:54.702734 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f11479e7-d7e6-45dc-8e8e-ab37a3a53f8f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:54.703869 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f11479e7-d7e6-45dc-8e8e-ab37a3a53f8f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:54.711184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f11479e7-d7e6-45dc-8e8e-ab37a3a53f8f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:54.711666 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f11479e7-d7e6-45dc-8e8e-ab37a3a53f8f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:54.712437 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f11479e7-d7e6-45dc-8e8e-ab37a3a53f8f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:54.712881 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f11479e7-d7e6-45dc-8e8e-ab37a3a53f8f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:54.740188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f11479e7-d7e6-45dc-8e8e-ab37a3a53f8f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041874 May 19 15:11:54.740737 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 347/691] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:11:54 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 15:11:54.799080 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9ec87877-64e0-4635-9c63-d69cd2c55f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:54.799597 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-9ec87877-64e0-4635-9c63-d69cd2c55f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:54.806470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9ec87877-64e0-4635-9c63-d69cd2c55f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:54.807177 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9ec87877-64e0-4635-9c63-d69cd2c55f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:54.808339 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9ec87877-64e0-4635-9c63-d69cd2c55f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:54.808992 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9ec87877-64e0-4635-9c63-d69cd2c55f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:54.844575 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-9ec87877-64e0-4635-9c63-d69cd2c55f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Going to try to terminate instance {{(pid=117445) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:11:54.924366 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9ec87877-64e0-4635-9c63-d69cd2c55f49 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "DELETE /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 204 len: 0 microversion: 2.1 time: 0.128765 May 19 15:11:54.925192 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 345/692] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:11:54 2022] DELETE /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:11:54.934113 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7d24a657-d1cf-4c5d-b2ff-bfae110ae527 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:54.934729 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7d24a657-d1cf-4c5d-b2ff-bfae110ae527 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:54.940648 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d24a657-d1cf-4c5d-b2ff-bfae110ae527 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:54.941100 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d24a657-d1cf-4c5d-b2ff-bfae110ae527 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:54.941864 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d24a657-d1cf-4c5d-b2ff-bfae110ae527 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:54.942928 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7d24a657-d1cf-4c5d-b2ff-bfae110ae527 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:55.083261 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7d24a657-d1cf-4c5d-b2ff-bfae110ae527 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:55.090807 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7d24a657-d1cf-4c5d-b2ff-bfae110ae527 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 200 len: 1679 microversion: 2.1 time: 0.160686 May 19 15:11:55.091404 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 348/693] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:54 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:11:56.101903 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e4d9637a-6b60-4cc3-bb89-bff8d71bae40 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:56.102493 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e4d9637a-6b60-4cc3-bb89-bff8d71bae40 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:56.106877 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0a13724c-660b-406c-b5d3-5d0ee2a810b4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:56.107598 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0a13724c-660b-406c-b5d3-5d0ee2a810b4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:56.109080 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e4d9637a-6b60-4cc3-bb89-bff8d71bae40 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:56.109542 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e4d9637a-6b60-4cc3-bb89-bff8d71bae40 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:56.110736 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e4d9637a-6b60-4cc3-bb89-bff8d71bae40 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:56.111393 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e4d9637a-6b60-4cc3-bb89-bff8d71bae40 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:56.114541 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0a13724c-660b-406c-b5d3-5d0ee2a810b4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:56.115012 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0a13724c-660b-406c-b5d3-5d0ee2a810b4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:56.115816 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0a13724c-660b-406c-b5d3-5d0ee2a810b4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:56.116257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0a13724c-660b-406c-b5d3-5d0ee2a810b4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:56.137668 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e4d9637a-6b60-4cc3-bb89-bff8d71bae40 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/ips" status: 200 len: 146 microversion: 2.1 time: 0.040416 May 19 15:11:56.138232 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 346/694] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 15:11:56 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:11:56.243734 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0a13724c-660b-406c-b5d3-5d0ee2a810b4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:56.251268 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0a13724c-660b-406c-b5d3-5d0ee2a810b4 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 200 len: 1679 microversion: 2.1 time: 0.148164 May 19 15:11:56.251847 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 349/695] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:56 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:11:57.270028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b2820330-ceab-48a9-bdb2-8fff217b4f10 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:57.271128 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b2820330-ceab-48a9-bdb2-8fff217b4f10 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:57.277633 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b2820330-ceab-48a9-bdb2-8fff217b4f10 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:57.278164 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b2820330-ceab-48a9-bdb2-8fff217b4f10 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:57.278996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b2820330-ceab-48a9-bdb2-8fff217b4f10 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:57.279520 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b2820330-ceab-48a9-bdb2-8fff217b4f10 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:57.343339 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-b2820330-ceab-48a9-bdb2-8fff217b4f10 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af7838e525a042dfa0357ad1fc58cf21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c1099557144b8bb2fff88f5b526834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:11:57.351375 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-b2820330-ceab-48a9-bdb2-8fff217b4f10 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 200 len: 1611 microversion: 2.1 time: 0.086763 May 19 15:11:57.351937 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 347/696] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:57 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 1611 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:11:57.488637 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-b94d3c15-2716-443e-bae4-8615462d2df3 req-3c880f0c-fa00-459f-a663-e40a7ab6cdd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a263534-d906-4c7d-9b25-88e0aca68b0c", "name": "network-vif-deleted", "tag": "755d6177-6434-4526-90a2-6d811cc92c76"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:57.496669 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=46 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:57.498806 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-b94d3c15-2716-443e-bae4-8615462d2df3 req-3c880f0c-fa00-459f-a663-e40a7ab6cdd4 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:57.499368 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-b94d3c15-2716-443e-bae4-8615462d2df3 req-3c880f0c-fa00-459f-a663-e40a7ab6cdd4 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:57.511591 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:11:57.521498 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-b94d3c15-2716-443e-bae4-8615462d2df3 req-3c880f0c-fa00-459f-a663-e40a7ab6cdd4 service nova] Creating event network-vif-deleted:755d6177-6434-4526-90a2-6d811cc92c76 for instance 1a263534-d906-4c7d-9b25-88e0aca68b0c on hv-cinder-82549 May 19 15:11:57.532598 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-b94d3c15-2716-443e-bae4-8615462d2df3 req-3c880f0c-fa00-459f-a663-e40a7ab6cdd4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046886 May 19 15:11:57.534143 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 350/697] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:11:58.369583 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-112eac2b-122d-48ee-a2aa-4d6b79e8949f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:58.370252 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-112eac2b-122d-48ee-a2aa-4d6b79e8949f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:58.377152 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-112eac2b-122d-48ee-a2aa-4d6b79e8949f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:58.377614 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-112eac2b-122d-48ee-a2aa-4d6b79e8949f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:58.378387 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-112eac2b-122d-48ee-a2aa-4d6b79e8949f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:58.378828 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-112eac2b-122d-48ee-a2aa-4d6b79e8949f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:58.392596 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-112eac2b-122d-48ee-a2aa-4d6b79e8949f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] HTTP exception thrown: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-112eac2b-122d-48ee-a2aa-4d6b79e8949f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Request method failure captured: May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c HTTP/1.1 May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihlzC36TVjbhLtU3g9xMp125AwUSov1duWZll1n5H-S_HScG7MruR7Gs1GViXAQd0SIJut8uotHNInm1_M2FBmXP1RayH0EJZ45YHoedSq6oTnynPABMFxjsri0-n9qTagsLk52YqxiHKDUiWNSXW6fHPq-ckGn5xy8R26VrSRWiq2XI May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:11:58.394360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:11:58.396035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_34c1099557144b8bb2fff88f5b526834", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:11:58.396035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:11:58.396035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:11:58.396035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:11:58.396035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:11:58.396035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:11:58.396035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:11:58.396035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: af7838e525a042dfa0357ad1fc58cf21 May 19 15:11:58.396035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:11:58.396035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:11:58.396035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. May 19 15:11:58.396035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '1a263534-d906-4c7d-9b25-88e0aca68b0c'} May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:11:58.396833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. May 19 15:11:58.398176 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:11:58.399381 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-112eac2b-122d-48ee-a2aa-4d6b79e8949f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Returning 404 to user: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:11:58.399381 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-112eac2b-122d-48ee-a2aa-4d6b79e8949f tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 404 len: 111 microversion: 2.1 time: 0.030442 May 19 15:11:58.399381 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 348/698] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:11:58 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:11:58.405487 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8dce5c48-492b-4584-a11b-7667fda53e56 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '.version_select at 0x7f35d12a8430>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:11:58.424150 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8dce5c48-492b-4584-a11b-7667fda53e56 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-729097809" status: 202 len: 0 microversion: 2.1 time: 0.022990 May 19 15:11:58.424729 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 351/699] 10.222.0.24 () {58 vars in 1217 bytes} [Thu May 19 15:11:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-729097809 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:11:58.866402 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b372595f-eeea-48c7-bdcc-c6e844e99f78 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef17bd58-2cfa-45a4-bbc6-41ee74bc9aa5"}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:11:58.867551 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b372595f-eeea-48c7-bdcc-c6e844e99f78 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:11:58.874541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b372595f-eeea-48c7-bdcc-c6e844e99f78 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:58.875073 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b372595f-eeea-48c7-bdcc-c6e844e99f78 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:58.875941 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b372595f-eeea-48c7-bdcc-c6e844e99f78 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:11:58.876440 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b372595f-eeea-48c7-bdcc-c6e844e99f78 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:11:59.150840 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-b372595f-eeea-48c7-bdcc-c6e844e99f78 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "POST /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288466 May 19 15:11:59.151479 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 349/700] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 15:11:58 2022] POST /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:12:00.176890 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-59cd445f-7e4f-4115-be29-0ede5b0362de tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:00.177511 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-59cd445f-7e4f-4115-be29-0ede5b0362de tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:00.183671 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59cd445f-7e4f-4115-be29-0ede5b0362de tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:00.184125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59cd445f-7e4f-4115-be29-0ede5b0362de tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:00.184890 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59cd445f-7e4f-4115-be29-0ede5b0362de tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:00.185329 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-59cd445f-7e4f-4115-be29-0ede5b0362de tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:00.198094 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-59cd445f-7e4f-4115-be29-0ede5b0362de tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] HTTP exception thrown: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-59cd445f-7e4f-4115-be29-0ede5b0362de tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Request method failure captured: May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c HTTP/1.1 May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihlzC36TVjbhLtU3g9xMp125AwUSov1duWZll1n5H-S_HScG7MruR7Gs1GViXAQd0SIJut8uotHNInm1_M2FBmXP1RayH0EJZ45YHoedSq6oTnynPABMFxjsri0-n9qTagsLk52YqxiHKDUiWNSXW6fHPq-ckGn5xy8R26VrSRWiq2XI May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:12:00.199747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:12:00.201356 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_34c1099557144b8bb2fff88f5b526834", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:12:00.201356 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:00.201356 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:00.201356 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:00.201356 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:00.201356 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:12:00.201356 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:12:00.201356 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: af7838e525a042dfa0357ad1fc58cf21 May 19 15:12:00.201356 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:00.201356 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:12:00.201356 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. May 19 15:12:00.201356 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': '1a263534-d906-4c7d-9b25-88e0aca68b0c'} May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:12:00.202306 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. May 19 15:12:00.203850 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:00.205367 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-59cd445f-7e4f-4115-be29-0ede5b0362de tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Returning 404 to user: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:12:00.205367 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-59cd445f-7e4f-4115-be29-0ede5b0362de tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "DELETE /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 404 len: 111 microversion: 2.1 time: 0.028644 May 19 15:12:00.205367 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 352/701] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:12:00 2022] DELETE /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:12:00.211397 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-223331b0-b529-43dc-b7af-4d906452662d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:00.211756 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-223331b0-b529-43dc-b7af-4d906452662d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 1a263534-d906-4c7d-9b25-88e0aca68b0c] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:00.217949 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-223331b0-b529-43dc-b7af-4d906452662d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:00.219243 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-223331b0-b529-43dc-b7af-4d906452662d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:00.219243 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-223331b0-b529-43dc-b7af-4d906452662d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:00.219635 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-223331b0-b529-43dc-b7af-4d906452662d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:00.233860 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-223331b0-b529-43dc-b7af-4d906452662d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] HTTP exception thrown: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-223331b0-b529-43dc-b7af-4d906452662d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Request method failure captured: May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c HTTP/1.1 May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihlzC36TVjbhLtU3g9xMp125AwUSov1duWZll1n5H-S_HScG7MruR7Gs1GViXAQd0SIJut8uotHNInm1_M2FBmXP1RayH0EJZ45YHoedSq6oTnynPABMFxjsri0-n9qTagsLk52YqxiHKDUiWNSXW6fHPq-ckGn5xy8R26VrSRWiq2XI May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:12:00.235526 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:12:00.237040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_34c1099557144b8bb2fff88f5b526834", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:12:00.237040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:00.237040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:00.237040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:00.237040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:00.237040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:12:00.237040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:12:00.237040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: af7838e525a042dfa0357ad1fc58cf21 May 19 15:12:00.237040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:00.237040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:12:00.237040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. May 19 15:12:00.237040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '1a263534-d906-4c7d-9b25-88e0aca68b0c'} May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:12:00.239067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. May 19 15:12:00.240491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:00.241742 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-223331b0-b529-43dc-b7af-4d906452662d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Returning 404 to user: Instance 1a263534-d906-4c7d-9b25-88e0aca68b0c could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:12:00.241742 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-223331b0-b529-43dc-b7af-4d906452662d tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c" status: 404 len: 111 microversion: 2.1 time: 0.031228 May 19 15:12:00.241742 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 350/702] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:00 2022] GET /compute/v2.1/servers/1a263534-d906-4c7d-9b25-88e0aca68b0c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:12:01.369866 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-31d20123-0c72-481a-bf41-f2badb6b2270 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:01.370369 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-31d20123-0c72-481a-bf41-f2badb6b2270 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:01.376854 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-31d20123-0c72-481a-bf41-f2badb6b2270 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:01.377310 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-31d20123-0c72-481a-bf41-f2badb6b2270 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:01.378082 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-31d20123-0c72-481a-bf41-f2badb6b2270 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:01.378525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-31d20123-0c72-481a-bf41-f2badb6b2270 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:01.392153 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-31d20123-0c72-481a-bf41-f2badb6b2270 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] HTTP exception thrown: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-31d20123-0c72-481a-bf41-f2badb6b2270 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Request method failure captured: May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f HTTP/1.1 May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihlzC36TVjbhLtU3g9xMp125AwUSov1duWZll1n5H-S_HScG7MruR7Gs1GViXAQd0SIJut8uotHNInm1_M2FBmXP1RayH0EJZ45YHoedSq6oTnynPABMFxjsri0-n9qTagsLk52YqxiHKDUiWNSXW6fHPq-ckGn5xy8R26VrSRWiq2XI May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:12:01.393675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:12:01.395862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_34c1099557144b8bb2fff88f5b526834", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:12:01.395862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:01.395862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:01.395862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:01.395862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:01.395862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:12:01.395862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:12:01.395862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: af7838e525a042dfa0357ad1fc58cf21 May 19 15:12:01.395862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:01.395862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:12:01.395862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. May 19 15:12:01.395862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': 'b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f'} May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:12:01.396814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. May 19 15:12:01.398241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:01.399922 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-31d20123-0c72-481a-bf41-f2badb6b2270 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Returning 404 to user: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:12:01.399922 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-31d20123-0c72-481a-bf41-f2badb6b2270 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "DELETE /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 404 len: 111 microversion: 2.1 time: 0.029506 May 19 15:12:01.399922 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 353/703] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:12:01 2022] DELETE /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:12:01.403830 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-302c1140-4405-4b82-816e-27b7cb811719 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:01.404431 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-302c1140-4405-4b82-816e-27b7cb811719 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:01.410856 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-302c1140-4405-4b82-816e-27b7cb811719 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:01.411338 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-302c1140-4405-4b82-816e-27b7cb811719 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:01.412089 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-302c1140-4405-4b82-816e-27b7cb811719 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:01.412545 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-302c1140-4405-4b82-816e-27b7cb811719 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:01.425403 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-302c1140-4405-4b82-816e-27b7cb811719 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] HTTP exception thrown: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-302c1140-4405-4b82-816e-27b7cb811719 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Request method failure captured: May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f HTTP/1.1 May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihlzC36TVjbhLtU3g9xMp125AwUSov1duWZll1n5H-S_HScG7MruR7Gs1GViXAQd0SIJut8uotHNInm1_M2FBmXP1RayH0EJZ45YHoedSq6oTnynPABMFxjsri0-n9qTagsLk52YqxiHKDUiWNSXW6fHPq-ckGn5xy8R26VrSRWiq2XI May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:12:01.426885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:12:01.428557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_34c1099557144b8bb2fff88f5b526834", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:12:01.428557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:01.428557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:01.428557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:01.428557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:01.428557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:12:01.428557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:12:01.428557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: af7838e525a042dfa0357ad1fc58cf21 May 19 15:12:01.428557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:01.428557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:12:01.428557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. May 19 15:12:01.428557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': 'b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f'} May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:12:01.429557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. May 19 15:12:01.430960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:01.432341 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-302c1140-4405-4b82-816e-27b7cb811719 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Returning 404 to user: Instance b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:12:01.432341 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-302c1140-4405-4b82-816e-27b7cb811719 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f" status: 404 len: 111 microversion: 2.1 time: 0.028193 May 19 15:12:01.432341 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 351/704] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:01 2022] GET /compute/v2.1/servers/b7b09b5b-25d2-4323-ab0f-6eb1b96eab9f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 15:12:01.436293 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c0c1b658-ad2a-4484-b15d-c6c7dbf6dc6e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:01.436805 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c0c1b658-ad2a-4484-b15d-c6c7dbf6dc6e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:01.443063 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0c1b658-ad2a-4484-b15d-c6c7dbf6dc6e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:01.443543 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0c1b658-ad2a-4484-b15d-c6c7dbf6dc6e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:01.444300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0c1b658-ad2a-4484-b15d-c6c7dbf6dc6e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:01.444734 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c0c1b658-ad2a-4484-b15d-c6c7dbf6dc6e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:01.458128 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-c0c1b658-ad2a-4484-b15d-c6c7dbf6dc6e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] HTTP exception thrown: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c0c1b658-ad2a-4484-b15d-c6c7dbf6dc6e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Request method failure captured: May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca HTTP/1.1 May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihlzC36TVjbhLtU3g9xMp125AwUSov1duWZll1n5H-S_HScG7MruR7Gs1GViXAQd0SIJut8uotHNInm1_M2FBmXP1RayH0EJZ45YHoedSq6oTnynPABMFxjsri0-n9qTagsLk52YqxiHKDUiWNSXW6fHPq-ckGn5xy8R26VrSRWiq2XI May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:12:01.459683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:12:01.461188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_34c1099557144b8bb2fff88f5b526834", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:12:01.461188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:01.461188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:01.461188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:01.461188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:01.461188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:12:01.461188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:12:01.461188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: af7838e525a042dfa0357ad1fc58cf21 May 19 15:12:01.461188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:01.461188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:12:01.461188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. May 19 15:12:01.461188 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': '2b9c3778-68d3-440a-b89c-22cf3a93baca'} May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:12:01.462184 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. May 19 15:12:01.463621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:01.465144 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c0c1b658-ad2a-4484-b15d-c6c7dbf6dc6e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Returning 404 to user: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:12:01.465144 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c0c1b658-ad2a-4484-b15d-c6c7dbf6dc6e tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "DELETE /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 404 len: 111 microversion: 2.1 time: 0.028535 May 19 15:12:01.465144 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 354/705] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:12:01 2022] DELETE /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:12:01.469267 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b88a6a3f-f314-4c2d-b7c6-d9e4eb6c83ff tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:01.469881 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b88a6a3f-f314-4c2d-b7c6-d9e4eb6c83ff tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: 2b9c3778-68d3-440a-b89c-22cf3a93baca] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:01.475836 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b88a6a3f-f314-4c2d-b7c6-d9e4eb6c83ff tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:01.476291 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b88a6a3f-f314-4c2d-b7c6-d9e4eb6c83ff tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:01.477139 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b88a6a3f-f314-4c2d-b7c6-d9e4eb6c83ff tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:01.477581 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b88a6a3f-f314-4c2d-b7c6-d9e4eb6c83ff tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:01.490469 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-b88a6a3f-f314-4c2d-b7c6-d9e4eb6c83ff tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] HTTP exception thrown: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b88a6a3f-f314-4c2d-b7c6-d9e4eb6c83ff tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Request method failure captured: May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca HTTP/1.1 May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihlzC36TVjbhLtU3g9xMp125AwUSov1duWZll1n5H-S_HScG7MruR7Gs1GViXAQd0SIJut8uotHNInm1_M2FBmXP1RayH0EJZ45YHoedSq6oTnynPABMFxjsri0-n9qTagsLk52YqxiHKDUiWNSXW6fHPq-ckGn5xy8R26VrSRWiq2XI May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:12:01.491996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:12:01.493777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_34c1099557144b8bb2fff88f5b526834", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:12:01.493777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:01.493777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:01.493777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:01.493777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:01.493777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:12:01.493777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:12:01.493777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: af7838e525a042dfa0357ad1fc58cf21 May 19 15:12:01.493777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:01.493777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:12:01.493777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. May 19 15:12:01.493777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '2b9c3778-68d3-440a-b89c-22cf3a93baca'} May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:12:01.494716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. May 19 15:12:01.496266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:01.497944 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b88a6a3f-f314-4c2d-b7c6-d9e4eb6c83ff tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Returning 404 to user: Instance 2b9c3778-68d3-440a-b89c-22cf3a93baca could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:12:01.497944 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-b88a6a3f-f314-4c2d-b7c6-d9e4eb6c83ff tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca" status: 404 len: 111 microversion: 2.1 time: 0.028179 May 19 15:12:01.497944 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 352/706] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:01 2022] GET /compute/v2.1/servers/2b9c3778-68d3-440a-b89c-22cf3a93baca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 15:12:02.629877 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-22e49ee4-2f1e-47cc-98bd-493e5b4199ba tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:02.630444 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-22e49ee4-2f1e-47cc-98bd-493e5b4199ba tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:02.636809 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-22e49ee4-2f1e-47cc-98bd-493e5b4199ba tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:02.637265 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-22e49ee4-2f1e-47cc-98bd-493e5b4199ba tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:02.638031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-22e49ee4-2f1e-47cc-98bd-493e5b4199ba tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:02.638477 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-22e49ee4-2f1e-47cc-98bd-493e5b4199ba tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:02.652103 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-22e49ee4-2f1e-47cc-98bd-493e5b4199ba tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] HTTP exception thrown: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-22e49ee4-2f1e-47cc-98bd-493e5b4199ba tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Request method failure captured: May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 HTTP/1.1 May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihlzC36TVjbhLtU3g9xMp125AwUSov1duWZll1n5H-S_HScG7MruR7Gs1GViXAQd0SIJut8uotHNInm1_M2FBmXP1RayH0EJZ45YHoedSq6oTnynPABMFxjsri0-n9qTagsLk52YqxiHKDUiWNSXW6fHPq-ckGn5xy8R26VrSRWiq2XI May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:12:02.653656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:12:02.655143 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_34c1099557144b8bb2fff88f5b526834", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:12:02.655143 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:02.655143 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:02.655143 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:02.655143 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:02.655143 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:12:02.655143 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:12:02.655143 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: af7838e525a042dfa0357ad1fc58cf21 May 19 15:12:02.655143 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:02.655143 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:12:02.655143 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. May 19 15:12:02.655143 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': 'cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3'} May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:12:02.656034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. May 19 15:12:02.657441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:02.658876 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-22e49ee4-2f1e-47cc-98bd-493e5b4199ba tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Returning 404 to user: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:12:02.658876 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-22e49ee4-2f1e-47cc-98bd-493e5b4199ba tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "DELETE /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 404 len: 111 microversion: 2.1 time: 0.028957 May 19 15:12:02.658876 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 355/707] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:12:02 2022] DELETE /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:12:02.663993 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c8454774-2694-4260-abf2-ab9ca6534e53 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:02.664605 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c8454774-2694-4260-abf2-ab9ca6534e53 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] [instance: cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:02.670920 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c8454774-2694-4260-abf2-ab9ca6534e53 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:02.671406 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c8454774-2694-4260-abf2-ab9ca6534e53 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:02.672166 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c8454774-2694-4260-abf2-ab9ca6534e53 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:02.672601 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c8454774-2694-4260-abf2-ab9ca6534e53 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:02.685388 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-c8454774-2694-4260-abf2-ab9ca6534e53 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] HTTP exception thrown: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c8454774-2694-4260-abf2-ab9ca6534e53 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Request method failure captured: May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 HTTP/1.1 May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihlzC36TVjbhLtU3g9xMp125AwUSov1duWZll1n5H-S_HScG7MruR7Gs1GViXAQd0SIJut8uotHNInm1_M2FBmXP1RayH0EJZ45YHoedSq6oTnynPABMFxjsri0-n9qTagsLk52YqxiHKDUiWNSXW6fHPq-ckGn5xy8R26VrSRWiq2XI May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:12:02.686924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:12:02.688470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_34c1099557144b8bb2fff88f5b526834", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/34c1099557144b8bb2fff88f5b526834"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:12:02.688470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:02.688470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 34c1099557144b8bb2fff88f5b526834 May 19 15:12:02.688470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1047460273 May 19 15:12:02.688470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:02.688470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:12:02.688470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:12:02.688470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: af7838e525a042dfa0357ad1fc58cf21 May 19 15:12:02.688470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-AttachVolumeNegativeTest-1047460273-project May 19 15:12:02.688470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:12:02.688470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. May 19 15:12:02.688470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': 'cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3'} May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:12:02.689266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. May 19 15:12:02.690495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:02.691562 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c8454774-2694-4260-abf2-ab9ca6534e53 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] Returning 404 to user: Instance cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:12:02.691562 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c8454774-2694-4260-abf2-ab9ca6534e53 tempest-AttachVolumeNegativeTest-1047460273 tempest-AttachVolumeNegativeTest-1047460273-project] 10.222.0.24 "GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3" status: 404 len: 111 microversion: 2.1 time: 0.028877 May 19 15:12:02.691562 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 353/708] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:02 2022] GET /compute/v2.1/servers/cd139aeb-d5c4-4d6b-aafd-c09d66e6cfd3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:12:05.622861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-01419275-ebd1-4966-9f7d-7debabf99a2b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:12:05.631869 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01419275-ebd1-4966-9f7d-7debabf99a2b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:05.632784 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01419275-ebd1-4966-9f7d-7debabf99a2b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:05.712596 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-01419275-ebd1-4966-9f7d-7debabf99a2b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Going to try to stop instance {{(pid=117444) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 15:12:05.764269 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-01419275-ebd1-4966-9f7d-7debabf99a2b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "POST /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/action" status: 202 len: 0 microversion: 2.1 time: 0.145142 May 19 15:12:05.764878 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 356/709] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 15:12:05 2022] POST /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:12:05.774269 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-8f852acb-a77c-4499-9a68-1393d1e61a06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:05.775470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-8f852acb-a77c-4499-9a68-1393d1e61a06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:05.788891 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8f852acb-a77c-4499-9a68-1393d1e61a06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:05.789412 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8f852acb-a77c-4499-9a68-1393d1e61a06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:05.790276 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8f852acb-a77c-4499-9a68-1393d1e61a06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:05.790766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8f852acb-a77c-4499-9a68-1393d1e61a06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:05.943035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8f852acb-a77c-4499-9a68-1393d1e61a06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:05.955040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-8f852acb-a77c-4499-9a68-1393d1e61a06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1725 microversion: 2.1 time: 0.185868 May 19 15:12:05.965984 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 354/710] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:05 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:06.973532 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5c2bdcab-c232-43d7-93e3-74401d79a6de tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:06.974239 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5c2bdcab-c232-43d7-93e3-74401d79a6de tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:06.980908 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5c2bdcab-c232-43d7-93e3-74401d79a6de tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:06.981362 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5c2bdcab-c232-43d7-93e3-74401d79a6de tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:06.982130 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5c2bdcab-c232-43d7-93e3-74401d79a6de tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:06.982570 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5c2bdcab-c232-43d7-93e3-74401d79a6de tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:07.122889 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5c2bdcab-c232-43d7-93e3-74401d79a6de tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:07.131866 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5c2bdcab-c232-43d7-93e3-74401d79a6de tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1725 microversion: 2.1 time: 0.162805 May 19 15:12:07.132444 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 357/711] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:06 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:08.149647 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e42447db-4066-4c0a-8a5f-9cf94dd1cfbe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:08.150291 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e42447db-4066-4c0a-8a5f-9cf94dd1cfbe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:08.157617 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e42447db-4066-4c0a-8a5f-9cf94dd1cfbe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:08.158055 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e42447db-4066-4c0a-8a5f-9cf94dd1cfbe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:08.158824 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e42447db-4066-4c0a-8a5f-9cf94dd1cfbe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:08.159283 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e42447db-4066-4c0a-8a5f-9cf94dd1cfbe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:08.285164 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-e42447db-4066-4c0a-8a5f-9cf94dd1cfbe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:08.293043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e42447db-4066-4c0a-8a5f-9cf94dd1cfbe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1725 microversion: 2.1 time: 0.147308 May 19 15:12:08.293603 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 355/712] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:08 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:09.311402 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6afa59fc-c98d-4e78-a679-792591413944 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:09.312144 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6afa59fc-c98d-4e78-a679-792591413944 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:09.320278 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6afa59fc-c98d-4e78-a679-792591413944 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:09.320740 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6afa59fc-c98d-4e78-a679-792591413944 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:09.321518 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6afa59fc-c98d-4e78-a679-792591413944 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:09.322057 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6afa59fc-c98d-4e78-a679-792591413944 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:09.476069 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6afa59fc-c98d-4e78-a679-792591413944 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:09.484185 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6afa59fc-c98d-4e78-a679-792591413944 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1725 microversion: 2.1 time: 0.178328 May 19 15:12:09.485122 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 358/713] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:09 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:10.502197 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-175f57ee-1a51-494b-aa81-a204701af363 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:10.502826 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-175f57ee-1a51-494b-aa81-a204701af363 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:10.510063 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-175f57ee-1a51-494b-aa81-a204701af363 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:10.510522 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-175f57ee-1a51-494b-aa81-a204701af363 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:10.511337 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-175f57ee-1a51-494b-aa81-a204701af363 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:10.511783 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-175f57ee-1a51-494b-aa81-a204701af363 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:10.652057 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-175f57ee-1a51-494b-aa81-a204701af363 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:10.659875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-175f57ee-1a51-494b-aa81-a204701af363 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1725 microversion: 2.1 time: 0.161690 May 19 15:12:10.661081 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 356/714] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:10 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:11.679738 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1caad540-cb97-4eab-acb4-8f58530f7932 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:11.680361 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1caad540-cb97-4eab-acb4-8f58530f7932 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:11.686899 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1caad540-cb97-4eab-acb4-8f58530f7932 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:11.687399 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1caad540-cb97-4eab-acb4-8f58530f7932 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:11.688171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1caad540-cb97-4eab-acb4-8f58530f7932 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:11.688615 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1caad540-cb97-4eab-acb4-8f58530f7932 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:11.816792 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1caad540-cb97-4eab-acb4-8f58530f7932 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:11.824943 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1caad540-cb97-4eab-acb4-8f58530f7932 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1725 microversion: 2.1 time: 0.149563 May 19 15:12:11.825543 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 359/715] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:11 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:12.841589 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-17a6b817-1588-455c-97ba-0051970cd93b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:12.842257 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-17a6b817-1588-455c-97ba-0051970cd93b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:12.848754 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-17a6b817-1588-455c-97ba-0051970cd93b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:12.849211 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-17a6b817-1588-455c-97ba-0051970cd93b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:12.849981 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-17a6b817-1588-455c-97ba-0051970cd93b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:12.850426 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-17a6b817-1588-455c-97ba-0051970cd93b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:12.979818 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-17a6b817-1588-455c-97ba-0051970cd93b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:12.987818 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-17a6b817-1588-455c-97ba-0051970cd93b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1725 microversion: 2.1 time: 0.150066 May 19 15:12:12.988875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 357/716] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:12 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:14.005392 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-885dd8c5-3e81-42e7-9721-4c70a7d55371 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:14.006777 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-885dd8c5-3e81-42e7-9721-4c70a7d55371 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:14.013027 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-885dd8c5-3e81-42e7-9721-4c70a7d55371 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:14.013533 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-885dd8c5-3e81-42e7-9721-4c70a7d55371 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:14.014263 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-885dd8c5-3e81-42e7-9721-4c70a7d55371 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:14.014683 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-885dd8c5-3e81-42e7-9721-4c70a7d55371 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:14.146505 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-885dd8c5-3e81-42e7-9721-4c70a7d55371 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:14.154417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-885dd8c5-3e81-42e7-9721-4c70a7d55371 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1725 microversion: 2.1 time: 0.153560 May 19 15:12:14.154981 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 360/717] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:13 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:15.171698 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-be35b99b-7288-40da-a812-2c602c0bee20 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:15.172306 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-be35b99b-7288-40da-a812-2c602c0bee20 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:15.179321 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-be35b99b-7288-40da-a812-2c602c0bee20 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:15.179774 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-be35b99b-7288-40da-a812-2c602c0bee20 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:15.180538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-be35b99b-7288-40da-a812-2c602c0bee20 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:15.180975 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-be35b99b-7288-40da-a812-2c602c0bee20 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:15.309981 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-be35b99b-7288-40da-a812-2c602c0bee20 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:15.318633 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-be35b99b-7288-40da-a812-2c602c0bee20 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1725 microversion: 2.1 time: 0.150830 May 19 15:12:15.319224 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 358/718] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:15 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:16.335226 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-272e6124-af9e-4996-8741-46726b1c52ca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:16.335853 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-272e6124-af9e-4996-8741-46726b1c52ca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:16.342275 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-272e6124-af9e-4996-8741-46726b1c52ca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:16.342728 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-272e6124-af9e-4996-8741-46726b1c52ca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:16.343549 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-272e6124-af9e-4996-8741-46726b1c52ca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:16.343989 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-272e6124-af9e-4996-8741-46726b1c52ca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:16.469985 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-272e6124-af9e-4996-8741-46726b1c52ca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:16.478341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-272e6124-af9e-4996-8741-46726b1c52ca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1725 microversion: 2.1 time: 0.147210 May 19 15:12:16.478904 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 361/719] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:16 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1725 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:17.495604 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-5268e814-9bc1-462d-8d49-6cd9be41a9f0 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:17.496240 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-5268e814-9bc1-462d-8d49-6cd9be41a9f0 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:17.502658 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5268e814-9bc1-462d-8d49-6cd9be41a9f0 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:17.503102 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5268e814-9bc1-462d-8d49-6cd9be41a9f0 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:17.503892 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5268e814-9bc1-462d-8d49-6cd9be41a9f0 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:17.504325 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5268e814-9bc1-462d-8d49-6cd9be41a9f0 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:17.506911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:17.629486 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5268e814-9bc1-462d-8d49-6cd9be41a9f0 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:17.637408 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-5268e814-9bc1-462d-8d49-6cd9be41a9f0 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1725 microversion: 2.1 time: 0.145880 May 19 15:12:17.637976 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 359/720] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:17 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:18.654127 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1cc804bb-cccb-475a-a927-8752bdf38a08 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:18.654832 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1cc804bb-cccb-475a-a927-8752bdf38a08 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:18.662217 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1cc804bb-cccb-475a-a927-8752bdf38a08 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:18.662675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1cc804bb-cccb-475a-a927-8752bdf38a08 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:18.663467 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1cc804bb-cccb-475a-a927-8752bdf38a08 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:18.663908 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1cc804bb-cccb-475a-a927-8752bdf38a08 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:18.795440 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1cc804bb-cccb-475a-a927-8752bdf38a08 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:18.803958 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1cc804bb-cccb-475a-a927-8752bdf38a08 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1725 microversion: 2.1 time: 0.153696 May 19 15:12:18.804532 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 362/721] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:18 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:19.823715 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c15d0713-4c06-44f8-a3b9-c64381abe084 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:19.824341 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c15d0713-4c06-44f8-a3b9-c64381abe084 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:19.831689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c15d0713-4c06-44f8-a3b9-c64381abe084 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:19.832151 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c15d0713-4c06-44f8-a3b9-c64381abe084 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:19.832936 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c15d0713-4c06-44f8-a3b9-c64381abe084 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:19.833371 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c15d0713-4c06-44f8-a3b9-c64381abe084 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:19.976092 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c15d0713-4c06-44f8-a3b9-c64381abe084 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:19.984776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c15d0713-4c06-44f8-a3b9-c64381abe084 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1725 microversion: 2.1 time: 0.164874 May 19 15:12:19.985334 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 360/722] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:19 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:21.001903 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-57e292ab-c070-4972-81bf-946d728075e2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:21.002526 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-57e292ab-c070-4972-81bf-946d728075e2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:21.008884 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-57e292ab-c070-4972-81bf-946d728075e2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:21.009340 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-57e292ab-c070-4972-81bf-946d728075e2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:21.010122 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-57e292ab-c070-4972-81bf-946d728075e2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:21.010562 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-57e292ab-c070-4972-81bf-946d728075e2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:21.159240 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-57e292ab-c070-4972-81bf-946d728075e2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:21.168809 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-57e292ab-c070-4972-81bf-946d728075e2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1725 microversion: 2.1 time: 0.170743 May 19 15:12:21.169283 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 363/723] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:20 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:22.185571 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ecbb6dc4-40ee-4ff6-a4ea-7f8e9257b19d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:22.186452 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ecbb6dc4-40ee-4ff6-a4ea-7f8e9257b19d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:22.194483 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ecbb6dc4-40ee-4ff6-a4ea-7f8e9257b19d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:22.195164 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ecbb6dc4-40ee-4ff6-a4ea-7f8e9257b19d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:22.196243 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ecbb6dc4-40ee-4ff6-a4ea-7f8e9257b19d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:22.196682 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ecbb6dc4-40ee-4ff6-a4ea-7f8e9257b19d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:22.324489 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ecbb6dc4-40ee-4ff6-a4ea-7f8e9257b19d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:22.333284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ecbb6dc4-40ee-4ff6-a4ea-7f8e9257b19d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1702 microversion: 2.1 time: 0.151621 May 19 15:12:22.333855 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 361/724] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:22 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1702 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:22.351152 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-36a3cc4f-aba8-4477-95f7-9985b9095e5e tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:12:22.357897 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-36a3cc4f-aba8-4477-95f7-9985b9095e5e tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:22.358354 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-36a3cc4f-aba8-4477-95f7-9985b9095e5e tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:22.383328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-36a3cc4f-aba8-4477-95f7-9985b9095e5e tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Going to try to start instance {{(pid=117444) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 15:12:22.424476 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-36a3cc4f-aba8-4477-95f7-9985b9095e5e tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "POST /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/action" status: 202 len: 0 microversion: 2.1 time: 0.077493 May 19 15:12:22.425089 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 364/725] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 15:12:22 2022] POST /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:12:22.433916 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6f748d44-530e-431b-8c2d-0f6f333191e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:22.434764 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-6f748d44-530e-431b-8c2d-0f6f333191e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:22.441338 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6f748d44-530e-431b-8c2d-0f6f333191e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:22.441775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6f748d44-530e-431b-8c2d-0f6f333191e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:22.442875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6f748d44-530e-431b-8c2d-0f6f333191e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:22.443553 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6f748d44-530e-431b-8c2d-0f6f333191e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:22.595756 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6f748d44-530e-431b-8c2d-0f6f333191e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:22.606606 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6f748d44-530e-431b-8c2d-0f6f333191e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1711 microversion: 2.1 time: 0.176423 May 19 15:12:22.607222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 362/726] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:22 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1711 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:23.625998 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b58c39c8-be62-4714-8649-e159456c49c2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:23.626615 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b58c39c8-be62-4714-8649-e159456c49c2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:23.633491 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b58c39c8-be62-4714-8649-e159456c49c2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:23.633951 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b58c39c8-be62-4714-8649-e159456c49c2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:23.634715 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b58c39c8-be62-4714-8649-e159456c49c2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:23.635152 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b58c39c8-be62-4714-8649-e159456c49c2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:23.762761 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b58c39c8-be62-4714-8649-e159456c49c2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:23.771410 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b58c39c8-be62-4714-8649-e159456c49c2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1711 microversion: 2.1 time: 0.150106 May 19 15:12:23.771979 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 365/727] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:23 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1711 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:24.788746 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b1d6738a-4be6-446e-9145-e45f29f5f592 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:24.789361 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b1d6738a-4be6-446e-9145-e45f29f5f592 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:24.791673 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:24.796930 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b1d6738a-4be6-446e-9145-e45f29f5f592 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:24.797382 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b1d6738a-4be6-446e-9145-e45f29f5f592 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:24.798147 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b1d6738a-4be6-446e-9145-e45f29f5f592 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:24.798587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b1d6738a-4be6-446e-9145-e45f29f5f592 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:24.927840 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-b1d6738a-4be6-446e-9145-e45f29f5f592 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:24.936074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-b1d6738a-4be6-446e-9145-e45f29f5f592 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1715 microversion: 2.1 time: 0.151171 May 19 15:12:24.936641 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 363/728] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:24 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:26.278675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-bee14ddc-de0a-4438-b87d-1f05c7b35ee2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:26.279725 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bee14ddc-de0a-4438-b87d-1f05c7b35ee2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:26.286513 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bee14ddc-de0a-4438-b87d-1f05c7b35ee2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:26.287026 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bee14ddc-de0a-4438-b87d-1f05c7b35ee2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:26.287774 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bee14ddc-de0a-4438-b87d-1f05c7b35ee2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:26.288216 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bee14ddc-de0a-4438-b87d-1f05c7b35ee2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:26.315703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-bee14ddc-de0a-4438-b87d-1f05c7b35ee2 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041673 May 19 15:12:26.316263 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 366/729] 10.222.0.24 () {60 vars in 1342 bytes} [Thu May 19 15:12:26 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:26.374133 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7929eaea-c381-4df4-8335-9b3dc19c1823 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:26.374865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7929eaea-c381-4df4-8335-9b3dc19c1823 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:26.384358 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7929eaea-c381-4df4-8335-9b3dc19c1823 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:26.384836 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7929eaea-c381-4df4-8335-9b3dc19c1823 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:26.385622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7929eaea-c381-4df4-8335-9b3dc19c1823 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:26.386045 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7929eaea-c381-4df4-8335-9b3dc19c1823 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:26.410140 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7929eaea-c381-4df4-8335-9b3dc19c1823 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Going to try to terminate instance {{(pid=117445) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:12:26.485822 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7929eaea-c381-4df4-8335-9b3dc19c1823 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 204 len: 0 microversion: 2.20 time: 0.115303 May 19 15:12:26.486594 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 364/730] 10.222.0.24 () {60 vars in 1279 bytes} [Thu May 19 15:12:26 2022] DELETE /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 15:12:26.496985 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f7715b5c-1080-4eda-8669-c25820f414b6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:26.498256 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f7715b5c-1080-4eda-8669-c25820f414b6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:26.505077 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f7715b5c-1080-4eda-8669-c25820f414b6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:26.506169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f7715b5c-1080-4eda-8669-c25820f414b6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:26.506940 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f7715b5c-1080-4eda-8669-c25820f414b6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:26.507576 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f7715b5c-1080-4eda-8669-c25820f414b6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:26.639735 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f7715b5c-1080-4eda-8669-c25820f414b6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:26.647536 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f7715b5c-1080-4eda-8669-c25820f414b6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:26.649073 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f7715b5c-1080-4eda-8669-c25820f414b6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:26.650232 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f7715b5c-1080-4eda-8669-c25820f414b6 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.158221 May 19 15:12:26.650795 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 367/731] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:12:26 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 15:12:27.668910 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-427fbcd5-89b6-4d36-b5dd-f97b0e161d50 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:27.669662 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-427fbcd5-89b6-4d36-b5dd-f97b0e161d50 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:27.676172 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-427fbcd5-89b6-4d36-b5dd-f97b0e161d50 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:27.676657 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-427fbcd5-89b6-4d36-b5dd-f97b0e161d50 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:27.677426 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-427fbcd5-89b6-4d36-b5dd-f97b0e161d50 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:27.677869 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-427fbcd5-89b6-4d36-b5dd-f97b0e161d50 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:27.807740 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-427fbcd5-89b6-4d36-b5dd-f97b0e161d50 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:27.815862 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-427fbcd5-89b6-4d36-b5dd-f97b0e161d50 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:27.817357 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-427fbcd5-89b6-4d36-b5dd-f97b0e161d50 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:27.819020 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-427fbcd5-89b6-4d36-b5dd-f97b0e161d50 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1720 microversion: 2.20 time: 0.154494 May 19 15:12:27.819615 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 365/732] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:12:27 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:12:28.802826 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-2da4fcf1-e64a-4bd7-bb4e-3bd82743fe81 req-177f4ec6-a615-477a-8b5f-60b0cc1cc18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7516d806-e895-4839-8142-5209040d1f2f", "name": "network-vif-deleted", "tag": "31aad5e7-16b4-45c8-b12a-2912bed903a1"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:12:28.806794 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:28.812632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-2da4fcf1-e64a-4bd7-bb4e-3bd82743fe81 req-177f4ec6-a615-477a-8b5f-60b0cc1cc18d service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:28.813088 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-2da4fcf1-e64a-4bd7-bb4e-3bd82743fe81 req-177f4ec6-a615-477a-8b5f-60b0cc1cc18d service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:28.817448 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:28.825862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-2da4fcf1-e64a-4bd7-bb4e-3bd82743fe81 req-177f4ec6-a615-477a-8b5f-60b0cc1cc18d service nova] Creating event network-vif-deleted:31aad5e7-16b4-45c8-b12a-2912bed903a1 for instance 7516d806-e895-4839-8142-5209040d1f2f on hv-cinder-82549 May 19 15:12:28.832856 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-2da4fcf1-e64a-4bd7-bb4e-3bd82743fe81 req-177f4ec6-a615-477a-8b5f-60b0cc1cc18d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032275 May 19 15:12:28.835700 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 368/733] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:12:28.842017 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ebc65343-9484-41df-8414-eefa54c5ae8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:28.842626 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ebc65343-9484-41df-8414-eefa54c5ae8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:28.851184 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ebc65343-9484-41df-8414-eefa54c5ae8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:28.852428 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ebc65343-9484-41df-8414-eefa54c5ae8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:28.855564 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ebc65343-9484-41df-8414-eefa54c5ae8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:28.856291 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ebc65343-9484-41df-8414-eefa54c5ae8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:28.944598 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ebc65343-9484-41df-8414-eefa54c5ae8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:28.954778 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ebc65343-9484-41df-8414-eefa54c5ae8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:28.956306 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ebc65343-9484-41df-8414-eefa54c5ae8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:28.957462 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ebc65343-9484-41df-8414-eefa54c5ae8b tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1365 microversion: 2.20 time: 0.120765 May 19 15:12:28.958023 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 366/734] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:12:28 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1365 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:12:29.977617 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c934e153-db07-4889-b5ad-3e48e4524be9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:29.978345 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c934e153-db07-4889-b5ad-3e48e4524be9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:29.985563 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c934e153-db07-4889-b5ad-3e48e4524be9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:29.986013 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c934e153-db07-4889-b5ad-3e48e4524be9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:29.986779 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c934e153-db07-4889-b5ad-3e48e4524be9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:29.987243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c934e153-db07-4889-b5ad-3e48e4524be9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:30.051086 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c934e153-db07-4889-b5ad-3e48e4524be9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:30.059559 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c934e153-db07-4889-b5ad-3e48e4524be9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:30.061054 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c934e153-db07-4889-b5ad-3e48e4524be9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:30.062186 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c934e153-db07-4889-b5ad-3e48e4524be9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1365 microversion: 2.20 time: 0.090018 May 19 15:12:30.062746 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 369/735] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:12:29 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1365 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:12:31.079578 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-298fafde-2b49-48ff-9fdf-2c97e2f90597 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:31.080103 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-298fafde-2b49-48ff-9fdf-2c97e2f90597 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:31.086555 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-298fafde-2b49-48ff-9fdf-2c97e2f90597 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:31.087022 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-298fafde-2b49-48ff-9fdf-2c97e2f90597 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:31.087804 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-298fafde-2b49-48ff-9fdf-2c97e2f90597 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:31.088245 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-298fafde-2b49-48ff-9fdf-2c97e2f90597 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:31.149832 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-298fafde-2b49-48ff-9fdf-2c97e2f90597 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:31.160454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-298fafde-2b49-48ff-9fdf-2c97e2f90597 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:31.162137 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-298fafde-2b49-48ff-9fdf-2c97e2f90597 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '644abe5583e94049abd23e4ca050a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edea803526e44a55b74472ecefdb0fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:31.163328 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-298fafde-2b49-48ff-9fdf-2c97e2f90597 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 200 len: 1365 microversion: 2.20 time: 0.087755 May 19 15:12:31.163881 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 367/736] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:12:31 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 1365 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 15:12:32.181441 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ccaa6fa1-5ece-44fb-9705-e7c788346af4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:32.182061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ccaa6fa1-5ece-44fb-9705-e7c788346af4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:32.188589 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ccaa6fa1-5ece-44fb-9705-e7c788346af4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:32.189045 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ccaa6fa1-5ece-44fb-9705-e7c788346af4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:32.189891 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ccaa6fa1-5ece-44fb-9705-e7c788346af4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:32.190341 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ccaa6fa1-5ece-44fb-9705-e7c788346af4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:32.203699 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-ccaa6fa1-5ece-44fb-9705-e7c788346af4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] HTTP exception thrown: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ccaa6fa1-5ece-44fb-9705-e7c788346af4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Request method failure captured: May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f HTTP/1.1 May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihlzM__jTohOtZrndaWvceCISqKFJD4aau4T53O7gL18XPKHZIZx-YcdR6hUQDJx_jCOmPmLd9T1JACzcwiydfkU6ISOVeKNS2GNJ1zXviSHARqrgF1SukhsSP2k-bWVV09rFNoru5e66LpVddV3ziUMvsXHXRoKRby4YMloSqoP5VQM May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Openstack-Nova-Api-Version: 2.20 May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: edea803526e44a55b74472ecefdb0fbc May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:12:32.205328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:12:32.206963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_edea803526e44a55b74472ecefdb0fbc", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:12:32.206963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:12:32.206963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: edea803526e44a55b74472ecefdb0fbc May 19 15:12:32.206963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:12:32.206963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeShelveTestJSON-489527708-project May 19 15:12:32.206963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:12:32.206963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:12:32.206963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: 644abe5583e94049abd23e4ca050a066 May 19 15:12:32.206963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeShelveTestJSON-489527708-project May 19 15:12:32.206963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:12:32.206963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. May 19 15:12:32.206963 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': '7516d806-e895-4839-8142-5209040d1f2f'} May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:12:32.207882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. May 19 15:12:32.210698 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:32.212757 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ccaa6fa1-5ece-44fb-9705-e7c788346af4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Returning 404 to user: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:12:32.212757 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ccaa6fa1-5ece-44fb-9705-e7c788346af4 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 404 len: 111 microversion: 2.20 time: 0.029276 May 19 15:12:32.212757 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 370/737] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:12:32 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 15:12:32.216220 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-db04d5ea-4436-4f9f-a45f-1ea3aaefcb32 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '.version_select at 0x7f35d14aa8b0>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:32.233070 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-db04d5ea-4436-4f9f-a45f-1ea3aaefcb32 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806985881" status: 204 len: 0 microversion: 2.20 time: 0.020627 May 19 15:12:32.233615 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 368/738] 10.222.0.24 () {60 vars in 1261 bytes} [Thu May 19 15:12:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1806985881 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 15:12:35.231282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-49c10495-e744-4bd8-9ff8-9815ceac2f64 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:35.232086 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-49c10495-e744-4bd8-9ff8-9815ceac2f64 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:35.241924 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49c10495-e744-4bd8-9ff8-9815ceac2f64 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:35.243011 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49c10495-e744-4bd8-9ff8-9815ceac2f64 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:35.244098 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49c10495-e744-4bd8-9ff8-9815ceac2f64 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:35.244671 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-49c10495-e744-4bd8-9ff8-9815ceac2f64 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:35.264280 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-49c10495-e744-4bd8-9ff8-9815ceac2f64 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] HTTP exception thrown: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-49c10495-e744-4bd8-9ff8-9815ceac2f64 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Request method failure captured: May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f HTTP/1.1 May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihlzM__jTohOtZrndaWvceCISqKFJD4aau4T53O7gL18XPKHZIZx-YcdR6hUQDJx_jCOmPmLd9T1JACzcwiydfkU6ISOVeKNS2GNJ1zXviSHARqrgF1SukhsSP2k-bWVV09rFNoru5e66LpVddV3ziUMvsXHXRoKRby4YMloSqoP5VQM May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Openstack-Nova-Api-Version: 2.20 May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: edea803526e44a55b74472ecefdb0fbc May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:12:35.265861 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:12:35.268155 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_edea803526e44a55b74472ecefdb0fbc", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:12:35.268155 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:12:35.268155 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: edea803526e44a55b74472ecefdb0fbc May 19 15:12:35.268155 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:12:35.268155 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeShelveTestJSON-489527708-project May 19 15:12:35.268155 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:12:35.268155 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:12:35.268155 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: 644abe5583e94049abd23e4ca050a066 May 19 15:12:35.268155 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeShelveTestJSON-489527708-project May 19 15:12:35.268155 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:12:35.268155 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. May 19 15:12:35.268155 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': '7516d806-e895-4839-8142-5209040d1f2f'} May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:12:35.269350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. May 19 15:12:35.272031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:35.275650 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-49c10495-e744-4bd8-9ff8-9815ceac2f64 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Returning 404 to user: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:12:35.275650 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-49c10495-e744-4bd8-9ff8-9815ceac2f64 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "DELETE /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 404 len: 111 microversion: 2.20 time: 0.040235 May 19 15:12:35.275650 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 371/739] 10.222.0.24 () {60 vars in 1279 bytes} [Thu May 19 15:12:35 2022] DELETE /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 15:12:35.277273 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e53f247e-88fd-4ca8-8f7d-38f6f333cdf9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:35.277886 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e53f247e-88fd-4ca8-8f7d-38f6f333cdf9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 7516d806-e895-4839-8142-5209040d1f2f] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:35.287918 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e53f247e-88fd-4ca8-8f7d-38f6f333cdf9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:35.288399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e53f247e-88fd-4ca8-8f7d-38f6f333cdf9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:35.289290 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e53f247e-88fd-4ca8-8f7d-38f6f333cdf9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:35.289807 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e53f247e-88fd-4ca8-8f7d-38f6f333cdf9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:35.304182 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-e53f247e-88fd-4ca8-8f7d-38f6f333cdf9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] HTTP exception thrown: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e53f247e-88fd-4ca8-8f7d-38f6f333cdf9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Request method failure captured: May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f HTTP/1.1 May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihlzM__jTohOtZrndaWvceCISqKFJD4aau4T53O7gL18XPKHZIZx-YcdR6hUQDJx_jCOmPmLd9T1JACzcwiydfkU6ISOVeKNS2GNJ1zXviSHARqrgF1SukhsSP2k-bWVV09rFNoru5e66LpVddV3ziUMvsXHXRoKRby4YMloSqoP5VQM May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Openstack-Nova-Api-Version: 2.20 May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: edea803526e44a55b74472ecefdb0fbc May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:12:35.305998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:12:35.307852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_edea803526e44a55b74472ecefdb0fbc", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:12:35.307852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:12:35.307852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: edea803526e44a55b74472ecefdb0fbc May 19 15:12:35.307852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:12:35.307852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-AttachVolumeShelveTestJSON-489527708-project May 19 15:12:35.307852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:12:35.307852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:12:35.307852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 644abe5583e94049abd23e4ca050a066 May 19 15:12:35.307852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-AttachVolumeShelveTestJSON-489527708-project May 19 15:12:35.307852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:12:35.307852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. May 19 15:12:35.307852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '7516d806-e895-4839-8142-5209040d1f2f'} May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:12:35.308735 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. May 19 15:12:35.310196 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:35.311555 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e53f247e-88fd-4ca8-8f7d-38f6f333cdf9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Returning 404 to user: Instance 7516d806-e895-4839-8142-5209040d1f2f could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:12:35.311555 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e53f247e-88fd-4ca8-8f7d-38f6f333cdf9 tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f" status: 404 len: 111 microversion: 2.20 time: 0.034842 May 19 15:12:35.311555 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 369/740] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:12:35 2022] GET /compute/v2.1/servers/7516d806-e895-4839-8142-5209040d1f2f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 19 15:12:36.446539 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7e4f1401-8342-487e-aa72-3ed0cf8f603a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:36.447030 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7e4f1401-8342-487e-aa72-3ed0cf8f603a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:36.453631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e4f1401-8342-487e-aa72-3ed0cf8f603a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:36.454164 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e4f1401-8342-487e-aa72-3ed0cf8f603a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:36.455019 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e4f1401-8342-487e-aa72-3ed0cf8f603a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:36.455599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e4f1401-8342-487e-aa72-3ed0cf8f603a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:36.474957 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-7e4f1401-8342-487e-aa72-3ed0cf8f603a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] HTTP exception thrown: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7e4f1401-8342-487e-aa72-3ed0cf8f603a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Request method failure captured: May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 HTTP/1.1 May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihlzM__jTohOtZrndaWvceCISqKFJD4aau4T53O7gL18XPKHZIZx-YcdR6hUQDJx_jCOmPmLd9T1JACzcwiydfkU6ISOVeKNS2GNJ1zXviSHARqrgF1SukhsSP2k-bWVV09rFNoru5e66LpVddV3ziUMvsXHXRoKRby4YMloSqoP5VQM May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Openstack-Nova-Api-Version: 2.20 May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: edea803526e44a55b74472ecefdb0fbc May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:12:36.476599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:12:36.478171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_edea803526e44a55b74472ecefdb0fbc", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:12:36.478171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:12:36.478171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: edea803526e44a55b74472ecefdb0fbc May 19 15:12:36.478171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:12:36.478171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeShelveTestJSON-489527708-project May 19 15:12:36.478171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:12:36.478171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:12:36.478171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: 644abe5583e94049abd23e4ca050a066 May 19 15:12:36.478171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeShelveTestJSON-489527708-project May 19 15:12:36.478171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:12:36.478171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. May 19 15:12:36.478171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': '6324753a-5912-42c2-a1f4-0bc631bea605'} May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:12:36.479061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. May 19 15:12:36.480550 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:12:36.482020 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7e4f1401-8342-487e-aa72-3ed0cf8f603a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Returning 404 to user: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:12:36.482020 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7e4f1401-8342-487e-aa72-3ed0cf8f603a tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "DELETE /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 404 len: 111 microversion: 2.20 time: 0.036038 May 19 15:12:36.482020 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 372/741] 10.222.0.24 () {60 vars in 1279 bytes} [Thu May 19 15:12:36 2022] DELETE /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 15:12:36.486255 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-632d2f63-c8f1-426e-8b5c-11808d92e16c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:36.486870 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-632d2f63-c8f1-426e-8b5c-11808d92e16c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] [instance: 6324753a-5912-42c2-a1f4-0bc631bea605] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:36.495003 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-632d2f63-c8f1-426e-8b5c-11808d92e16c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:36.495507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-632d2f63-c8f1-426e-8b5c-11808d92e16c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:36.496280 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-632d2f63-c8f1-426e-8b5c-11808d92e16c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:36.496723 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-632d2f63-c8f1-426e-8b5c-11808d92e16c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:36.509693 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-632d2f63-c8f1-426e-8b5c-11808d92e16c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] HTTP exception thrown: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-632d2f63-c8f1-426e-8b5c-11808d92e16c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Request method failure captured: May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 HTTP/1.1 May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihlzM__jTohOtZrndaWvceCISqKFJD4aau4T53O7gL18XPKHZIZx-YcdR6hUQDJx_jCOmPmLd9T1JACzcwiydfkU6ISOVeKNS2GNJ1zXviSHARqrgF1SukhsSP2k-bWVV09rFNoru5e66LpVddV3ziUMvsXHXRoKRby4YMloSqoP5VQM May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Openstack-Nova-Api-Version: 2.20 May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: edea803526e44a55b74472ecefdb0fbc May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:12:36.511268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:12:36.512879 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_edea803526e44a55b74472ecefdb0fbc", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/edea803526e44a55b74472ecefdb0fbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:12:36.512879 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:12:36.512879 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: edea803526e44a55b74472ecefdb0fbc May 19 15:12:36.512879 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-489527708 May 19 15:12:36.512879 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-AttachVolumeShelveTestJSON-489527708-project May 19 15:12:36.512879 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:12:36.512879 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:12:36.512879 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 644abe5583e94049abd23e4ca050a066 May 19 15:12:36.512879 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-AttachVolumeShelveTestJSON-489527708-project May 19 15:12:36.512879 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:12:36.512879 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. May 19 15:12:36.512879 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '6324753a-5912-42c2-a1f4-0bc631bea605'} May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:12:36.513770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. May 19 15:12:36.515190 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:12:36.516516 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-632d2f63-c8f1-426e-8b5c-11808d92e16c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] Returning 404 to user: Instance 6324753a-5912-42c2-a1f4-0bc631bea605 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:12:36.516516 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-632d2f63-c8f1-426e-8b5c-11808d92e16c tempest-AttachVolumeShelveTestJSON-489527708 tempest-AttachVolumeShelveTestJSON-489527708-project] 10.222.0.24 "GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605" status: 404 len: 111 microversion: 2.20 time: 0.030188 May 19 15:12:36.516516 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 370/742] 10.222.0.24 () {60 vars in 1276 bytes} [Thu May 19 15:12:36 2022] GET /compute/v2.1/servers/6324753a-5912-42c2-a1f4-0bc631bea605 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 15:12:44.165022 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-abf81753-4d35-4129-b408-60bd12cc975e tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] Calling method '.version_select at 0x7f35d1490430>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:44.212803 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-abf81753-4d35-4129-b408-60bd12cc975e tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/5fbbb3b3-976e-4c59-91e2-8d1bcbc24589" status: 200 len: 350 microversion: 2.1 time: 0.051572 May 19 15:12:44.213361 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 373/743] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 15:12:44 2022] GET /compute/v2.1/os-volumes/5fbbb3b3-976e-4c59-91e2-8d1bcbc24589 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:12:45.530016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9c35e061-1d06-4625-8153-ac2ef9a99fe3 tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] Calling method '.version_select at 0x7f35d1363ee0>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:45.577164 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9c35e061-1d06-4625-8153-ac2ef9a99fe3 tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/81153124-92e9-4d1d-a92d-e0acc72195f9" status: 200 len: 351 microversion: 2.1 time: 0.051066 May 19 15:12:45.577755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 371/744] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 15:12:45 2022] GET /compute/v2.1/os-volumes/81153124-92e9-4d1d-a92d-e0acc72195f9 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:12:46.893015 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=9 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:46.894109 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=13 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:46.897930 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-09b18092-523c-4c77-a9d0-41f337e6c07a tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] Calling method '.version_select at 0x7f35d1204040>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:46.949357 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-09b18092-523c-4c77-a9d0-41f337e6c07a tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/f15868e2-912b-4779-9f30-807c63530420" status: 200 len: 350 microversion: 2.1 time: 0.057925 May 19 15:12:46.949945 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 374/745] 10.222.0.24 () {58 vars in 1244 bytes} [Thu May 19 15:12:46 2022] GET /compute/v2.1/os-volumes/f15868e2-912b-4779-9f30-807c63530420 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:12:46.957871 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:46.958687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:12:46.962910 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-537e3998-69c2-48f8-8d91-85214eb82232 tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] Calling method '.version_select at 0x7f35d149ea60>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:47.048523 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-537e3998-69c2-48f8-8d91-85214eb82232 tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.091357 May 19 15:12:47.049089 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 372/746] 10.222.0.24 () {58 vars in 1133 bytes} [Thu May 19 15:12:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:12:47.061739 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-53ab2d39-62bd-4942-9d11-214c51e4b391 tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] Calling method '.version_select at 0x7f35d1262c10>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:47.146848 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-53ab2d39-62bd-4942-9d11-214c51e4b391 tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088518 May 19 15:12:47.147449 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 375/747] 10.222.0.24 () {58 vars in 1148 bytes} [Thu May 19 15:12:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:12:47.158890 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-73114827-7e54-45f0-9708-ca1162294a9f tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] Calling method '.version_select at 0x7f35d1363280>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:47.239877 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-73114827-7e54-45f0-9708-ca1162294a9f tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084624 May 19 15:12:47.240440 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 373/748] 10.222.0.24 () {58 vars in 1133 bytes} [Thu May 19 15:12:47 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:47.251716 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7fd29355-44a1-4ea8-b7eb-77a39d0fe584 tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] Calling method '.version_select at 0x7f35d11fe040>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:47.336215 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7fd29355-44a1-4ea8-b7eb-77a39d0fe584 tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088174 May 19 15:12:47.336785 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 376/749] 10.222.0.24 () {58 vars in 1166 bytes} [Thu May 19 15:12:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:12:47.348353 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6482e1ee-e177-4b09-b389-da1ead090886 tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] Calling method '.version_select at 0x7f35d124c820>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:47.434015 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6482e1ee-e177-4b09-b389-da1ead090886 tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089396 May 19 15:12:47.434597 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 374/750] 10.222.0.24 () {58 vars in 1169 bytes} [Thu May 19 15:12:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:12:47.446824 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-66ac2a97-ba9d-4180-8011-705d206f4981 tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] Calling method '.version_select at 0x7f35d132fd30>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:47.534675 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-66ac2a97-ba9d-4180-8011-705d206f4981 tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.091509 May 19 15:12:47.535271 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 377/751] 10.222.0.24 () {58 vars in 1154 bytes} [Thu May 19 15:12:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:12:47.546999 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f1fc2574-3de8-4325-a107-d019508d0ad6 tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] Calling method '.version_select at 0x7f35d14aa0d0>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:47.630589 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f1fc2574-3de8-4325-a107-d019508d0ad6 tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087211 May 19 15:12:47.631155 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 375/752] 10.222.0.24 () {58 vars in 1187 bytes} [Thu May 19 15:12:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:12:47.642645 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1d1335f8-ddb5-4c54-ad22-ac8db807b2ee tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] Calling method '.version_select at 0x7f35d14a7040>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:47.732713 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1d1335f8-ddb5-4c54-ad22-ac8db807b2ee tempest-VolumesTestJSON-1831998286 tempest-VolumesTestJSON-1831998286-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.093946 May 19 15:12:47.733633 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 378/753] 10.222.0.24 () {58 vars in 1154 bytes} [Thu May 19 15:12:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:56.986060 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-df68d449-1387-4c91-a6f9-67cc67edf303 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:12:56.986060 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-df68d449-1387-4c91-a6f9-67cc67edf303 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:56.990112 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-df68d449-1387-4c91-a6f9-67cc67edf303 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:56.990740 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-df68d449-1387-4c91-a6f9-67cc67edf303 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:56.991691 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-df68d449-1387-4c91-a6f9-67cc67edf303 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:56.992493 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-df68d449-1387-4c91-a6f9-67cc67edf303 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:57.016520 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-df68d449-1387-4c91-a6f9-67cc67edf303 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lazy-loading 'flavor' on Instance uuid 81d166a7-9804-44f0-8e9a-a901a6a29cdc {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:12:57.135268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-df68d449-1387-4c91-a6f9-67cc67edf303 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "POST /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc/action" status: 202 len: 0 microversion: 2.1 time: 0.157176 May 19 15:12:57.136128 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 376/754] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 15:12:56 2022] POST /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:12:57.146663 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3a95d1f7-f758-4714-b947-bd0f28da8e07 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:57.148177 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3a95d1f7-f758-4714-b947-bd0f28da8e07 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:57.155820 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3a95d1f7-f758-4714-b947-bd0f28da8e07 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:57.157255 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3a95d1f7-f758-4714-b947-bd0f28da8e07 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:57.158284 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3a95d1f7-f758-4714-b947-bd0f28da8e07 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:57.158907 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3a95d1f7-f758-4714-b947-bd0f28da8e07 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:57.319033 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3a95d1f7-f758-4714-b947-bd0f28da8e07 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:57.332532 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3a95d1f7-f758-4714-b947-bd0f28da8e07 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1569 microversion: 2.1 time: 0.191485 May 19 15:12:57.334049 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 379/755] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:57 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:57.964473 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-1979024a-7dd4-4357-826a-bd9c9f87b7e9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:57.965058 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-1979024a-7dd4-4357-826a-bd9c9f87b7e9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:57.971358 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1979024a-7dd4-4357-826a-bd9c9f87b7e9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:57.971746 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1979024a-7dd4-4357-826a-bd9c9f87b7e9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:57.972470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1979024a-7dd4-4357-826a-bd9c9f87b7e9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:57.972917 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1979024a-7dd4-4357-826a-bd9c9f87b7e9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:58.055711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-1979024a-7dd4-4357-826a-bd9c9f87b7e9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lazy-loading 'services' on Instance uuid f20c74e3-1f32-4118-b98b-2e60725d9ea2 {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:12:58.130348 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-1979024a-7dd4-4357-826a-bd9c9f87b7e9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/os-volume_attachments/ef17bd58-2cfa-45a4-bbc6-41ee74bc9aa5" status: 202 len: 0 microversion: 2.1 time: 0.169433 May 19 15:12:58.131163 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 377/756] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 15:12:57 2022] DELETE /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/os-volume_attachments/ef17bd58-2cfa-45a4-bbc6-41ee74bc9aa5 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:12:58.350505 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ca52c6ad-3773-40eb-b485-fae4b350e5e6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:58.351126 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ca52c6ad-3773-40eb-b485-fae4b350e5e6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:58.357766 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca52c6ad-3773-40eb-b485-fae4b350e5e6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:58.358290 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca52c6ad-3773-40eb-b485-fae4b350e5e6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:58.359158 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca52c6ad-3773-40eb-b485-fae4b350e5e6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:58.359688 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca52c6ad-3773-40eb-b485-fae4b350e5e6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:58.498006 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ca52c6ad-3773-40eb-b485-fae4b350e5e6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:58.505498 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ca52c6ad-3773-40eb-b485-fae4b350e5e6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1569 microversion: 2.1 time: 0.159574 May 19 15:12:58.506081 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 380/757] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:58 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:59.248046 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-842fd58a-8840-440b-89a0-d0854f58dc40 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:12:59.254113 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-842fd58a-8840-440b-89a0-d0854f58dc40 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:59.255121 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-842fd58a-8840-440b-89a0-d0854f58dc40 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:59.317846 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-842fd58a-8840-440b-89a0-d0854f58dc40 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Going to try to stop instance {{(pid=117445) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 15:12:59.362507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-842fd58a-8840-440b-89a0-d0854f58dc40 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "POST /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/action" status: 202 len: 0 microversion: 2.1 time: 0.119007 May 19 15:12:59.363407 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 378/758] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 15:12:59 2022] POST /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:12:59.372205 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-975cd6f4-6a29-4de6-bd73-089597cfc48f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:59.372833 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-975cd6f4-6a29-4de6-bd73-089597cfc48f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:59.385529 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-975cd6f4-6a29-4de6-bd73-089597cfc48f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:59.386521 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-975cd6f4-6a29-4de6-bd73-089597cfc48f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:59.387670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-975cd6f4-6a29-4de6-bd73-089597cfc48f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:59.388313 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-975cd6f4-6a29-4de6-bd73-089597cfc48f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:59.524475 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ab483d29-e5f8-4026-91e0-76107c6d216e tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:12:59.525127 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-975cd6f4-6a29-4de6-bd73-089597cfc48f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:59.525551 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ab483d29-e5f8-4026-91e0-76107c6d216e tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:12:59.531937 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ab483d29-e5f8-4026-91e0-76107c6d216e tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:59.532478 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ab483d29-e5f8-4026-91e0-76107c6d216e tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:59.533167 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-975cd6f4-6a29-4de6-bd73-089597cfc48f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1679 microversion: 2.1 time: 0.164941 May 19 15:12:59.533509 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ab483d29-e5f8-4026-91e0-76107c6d216e tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:12:59.534071 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 381/759] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:59 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:12:59.534221 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ab483d29-e5f8-4026-91e0-76107c6d216e tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:12:59.681152 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ab483d29-e5f8-4026-91e0-76107c6d216e tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:12:59.688981 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ab483d29-e5f8-4026-91e0-76107c6d216e tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1569 microversion: 2.1 time: 0.169620 May 19 15:12:59.689742 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 379/760] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:12:59 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:00.551164 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2e950cfc-337d-4947-99dd-10c03762747e tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:00.552392 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2e950cfc-337d-4947-99dd-10c03762747e tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:00.558739 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2e950cfc-337d-4947-99dd-10c03762747e tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:00.559237 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2e950cfc-337d-4947-99dd-10c03762747e tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:00.560003 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2e950cfc-337d-4947-99dd-10c03762747e tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:00.560435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2e950cfc-337d-4947-99dd-10c03762747e tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:00.694800 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2e950cfc-337d-4947-99dd-10c03762747e tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:00.702784 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2e950cfc-337d-4947-99dd-10c03762747e tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1679 microversion: 2.1 time: 0.155427 May 19 15:13:00.703533 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 382/761] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:00 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:00.705577 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7459e7d8-d22d-4847-90a0-c1f135a1b992 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:00.706804 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7459e7d8-d22d-4847-90a0-c1f135a1b992 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:00.714873 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7459e7d8-d22d-4847-90a0-c1f135a1b992 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:00.715330 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7459e7d8-d22d-4847-90a0-c1f135a1b992 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:00.716372 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7459e7d8-d22d-4847-90a0-c1f135a1b992 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:00.716826 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7459e7d8-d22d-4847-90a0-c1f135a1b992 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:00.854400 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7459e7d8-d22d-4847-90a0-c1f135a1b992 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:00.862235 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7459e7d8-d22d-4847-90a0-c1f135a1b992 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1569 microversion: 2.1 time: 0.160457 May 19 15:13:00.862811 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 380/762] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:00 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:13:01.720804 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cff0605b-1c36-4e2e-88a8-c046f273a5a8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:01.721423 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cff0605b-1c36-4e2e-88a8-c046f273a5a8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:01.728457 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cff0605b-1c36-4e2e-88a8-c046f273a5a8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:01.728917 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cff0605b-1c36-4e2e-88a8-c046f273a5a8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:01.729691 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cff0605b-1c36-4e2e-88a8-c046f273a5a8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:01.730137 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cff0605b-1c36-4e2e-88a8-c046f273a5a8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:01.858847 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-cff0605b-1c36-4e2e-88a8-c046f273a5a8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:01.867029 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cff0605b-1c36-4e2e-88a8-c046f273a5a8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1679 microversion: 2.1 time: 0.150059 May 19 15:13:01.867903 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 383/763] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:01 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:01.879137 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4dbf4269-fe1c-4be9-af4d-985adef56259 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:01.880335 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4dbf4269-fe1c-4be9-af4d-985adef56259 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:01.887691 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4dbf4269-fe1c-4be9-af4d-985adef56259 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:01.888143 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4dbf4269-fe1c-4be9-af4d-985adef56259 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:01.888908 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4dbf4269-fe1c-4be9-af4d-985adef56259 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:01.889341 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4dbf4269-fe1c-4be9-af4d-985adef56259 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:02.033424 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4dbf4269-fe1c-4be9-af4d-985adef56259 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:02.041835 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4dbf4269-fe1c-4be9-af4d-985adef56259 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1569 microversion: 2.1 time: 0.166425 May 19 15:13:02.042398 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 381/764] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:01 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:02.884936 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d4d9853e-b861-499d-bd6a-83152196b838 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:02.885555 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d4d9853e-b861-499d-bd6a-83152196b838 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:02.892320 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d4d9853e-b861-499d-bd6a-83152196b838 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:02.892785 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d4d9853e-b861-499d-bd6a-83152196b838 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:02.893593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d4d9853e-b861-499d-bd6a-83152196b838 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:02.893999 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d4d9853e-b861-499d-bd6a-83152196b838 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:03.024340 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d4d9853e-b861-499d-bd6a-83152196b838 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:03.031744 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d4d9853e-b861-499d-bd6a-83152196b838 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1679 microversion: 2.1 time: 0.150640 May 19 15:13:03.032318 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 384/765] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:02 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:03.057754 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9402df92-94f4-44a3-8799-646fcfd7d8ce tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:03.058362 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-9402df92-94f4-44a3-8799-646fcfd7d8ce tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:03.065188 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9402df92-94f4-44a3-8799-646fcfd7d8ce tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:03.065704 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9402df92-94f4-44a3-8799-646fcfd7d8ce tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:03.066543 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9402df92-94f4-44a3-8799-646fcfd7d8ce tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:03.067662 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9402df92-94f4-44a3-8799-646fcfd7d8ce tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:03.212508 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9402df92-94f4-44a3-8799-646fcfd7d8ce tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:03.220865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9402df92-94f4-44a3-8799-646fcfd7d8ce tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1569 microversion: 2.1 time: 0.166862 May 19 15:13:03.221864 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 382/766] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:03 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:04.049811 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-552f5228-8036-4100-a455-e8401b7c82bd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:04.050439 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-552f5228-8036-4100-a455-e8401b7c82bd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:04.057323 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-552f5228-8036-4100-a455-e8401b7c82bd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:04.057785 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-552f5228-8036-4100-a455-e8401b7c82bd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:04.058540 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-552f5228-8036-4100-a455-e8401b7c82bd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:04.058974 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-552f5228-8036-4100-a455-e8401b7c82bd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:04.193283 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-552f5228-8036-4100-a455-e8401b7c82bd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:04.200654 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-552f5228-8036-4100-a455-e8401b7c82bd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1679 microversion: 2.1 time: 0.155402 May 19 15:13:04.201222 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 385/767] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:04 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:04.237665 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f7e2ab95-bfc7-4de6-9d5c-045e27a6e36d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:04.238280 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f7e2ab95-bfc7-4de6-9d5c-045e27a6e36d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:04.245775 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7e2ab95-bfc7-4de6-9d5c-045e27a6e36d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:04.246233 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7e2ab95-bfc7-4de6-9d5c-045e27a6e36d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:04.247000 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7e2ab95-bfc7-4de6-9d5c-045e27a6e36d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:04.247470 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7e2ab95-bfc7-4de6-9d5c-045e27a6e36d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:04.377157 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f7e2ab95-bfc7-4de6-9d5c-045e27a6e36d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:04.384855 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f7e2ab95-bfc7-4de6-9d5c-045e27a6e36d tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1569 microversion: 2.1 time: 0.151037 May 19 15:13:04.385416 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 383/768] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:04 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:05.217591 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f1f712f0-8266-4d46-8f89-eb7a2b8b3a48 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:05.218906 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f1f712f0-8266-4d46-8f89-eb7a2b8b3a48 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:05.225563 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f1f712f0-8266-4d46-8f89-eb7a2b8b3a48 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:05.226025 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f1f712f0-8266-4d46-8f89-eb7a2b8b3a48 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:05.226798 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f1f712f0-8266-4d46-8f89-eb7a2b8b3a48 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:05.227261 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f1f712f0-8266-4d46-8f89-eb7a2b8b3a48 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:05.359629 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f1f712f0-8266-4d46-8f89-eb7a2b8b3a48 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:05.368329 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f1f712f0-8266-4d46-8f89-eb7a2b8b3a48 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1679 microversion: 2.1 time: 0.154451 May 19 15:13:05.368923 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 386/769] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:05 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:05.401725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ce5d08e2-b10d-45c6-896f-ee046259c46c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:05.402334 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ce5d08e2-b10d-45c6-896f-ee046259c46c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:05.410077 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ce5d08e2-b10d-45c6-896f-ee046259c46c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:05.410899 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ce5d08e2-b10d-45c6-896f-ee046259c46c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:05.411942 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ce5d08e2-b10d-45c6-896f-ee046259c46c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:05.412453 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ce5d08e2-b10d-45c6-896f-ee046259c46c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:05.545661 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ce5d08e2-b10d-45c6-896f-ee046259c46c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:05.553747 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ce5d08e2-b10d-45c6-896f-ee046259c46c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1569 microversion: 2.1 time: 0.155844 May 19 15:13:05.554315 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 384/770] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:05 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:06.384662 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-4a436d10-17a5-42d2-a5e0-22356ba6319f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:06.385276 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-4a436d10-17a5-42d2-a5e0-22356ba6319f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:06.391745 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4a436d10-17a5-42d2-a5e0-22356ba6319f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:06.392191 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4a436d10-17a5-42d2-a5e0-22356ba6319f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:06.392959 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4a436d10-17a5-42d2-a5e0-22356ba6319f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:06.393572 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-4a436d10-17a5-42d2-a5e0-22356ba6319f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:06.543751 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-4a436d10-17a5-42d2-a5e0-22356ba6319f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:06.559814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-4a436d10-17a5-42d2-a5e0-22356ba6319f tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1679 microversion: 2.1 time: 0.178920 May 19 15:13:06.560730 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 387/771] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:06 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:06.572229 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-76bd863a-b8eb-40a7-ac0f-7ca362ef6e9a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:06.572952 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-76bd863a-b8eb-40a7-ac0f-7ca362ef6e9a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:06.580217 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-76bd863a-b8eb-40a7-ac0f-7ca362ef6e9a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:06.580796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-76bd863a-b8eb-40a7-ac0f-7ca362ef6e9a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:06.581650 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-76bd863a-b8eb-40a7-ac0f-7ca362ef6e9a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:06.582248 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-76bd863a-b8eb-40a7-ac0f-7ca362ef6e9a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:06.718465 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-76bd863a-b8eb-40a7-ac0f-7ca362ef6e9a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:06.726567 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-76bd863a-b8eb-40a7-ac0f-7ca362ef6e9a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1569 microversion: 2.1 time: 0.159821 May 19 15:13:06.727322 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 385/772] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:06 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:13:07.577626 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3eff87d1-9d5c-4b0c-ad08-b36b79a946fe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:07.578460 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3eff87d1-9d5c-4b0c-ad08-b36b79a946fe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:07.585917 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3eff87d1-9d5c-4b0c-ad08-b36b79a946fe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:07.586502 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3eff87d1-9d5c-4b0c-ad08-b36b79a946fe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:07.587491 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3eff87d1-9d5c-4b0c-ad08-b36b79a946fe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:07.587928 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3eff87d1-9d5c-4b0c-ad08-b36b79a946fe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:07.739868 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3eff87d1-9d5c-4b0c-ad08-b36b79a946fe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:07.746379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ad68b97d-3467-4344-980b-dfe81aa86890 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:07.747831 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ad68b97d-3467-4344-980b-dfe81aa86890 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:07.750241 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3eff87d1-9d5c-4b0c-ad08-b36b79a946fe tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1679 microversion: 2.1 time: 0.176573 May 19 15:13:07.751219 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 388/773] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:07 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:07.764486 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ad68b97d-3467-4344-980b-dfe81aa86890 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:07.765549 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ad68b97d-3467-4344-980b-dfe81aa86890 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:07.766558 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ad68b97d-3467-4344-980b-dfe81aa86890 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:07.767162 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ad68b97d-3467-4344-980b-dfe81aa86890 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:07.951053 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ad68b97d-3467-4344-980b-dfe81aa86890 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:07.959220 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ad68b97d-3467-4344-980b-dfe81aa86890 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1569 microversion: 2.1 time: 0.218488 May 19 15:13:07.968605 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 386/774] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:07 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:13:08.767917 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-98f3fb96-015d-424c-9cce-beccba0ae921 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:08.768528 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-98f3fb96-015d-424c-9cce-beccba0ae921 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:08.775867 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98f3fb96-015d-424c-9cce-beccba0ae921 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:08.776321 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98f3fb96-015d-424c-9cce-beccba0ae921 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:08.777079 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98f3fb96-015d-424c-9cce-beccba0ae921 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:08.777513 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-98f3fb96-015d-424c-9cce-beccba0ae921 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:08.903657 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-98f3fb96-015d-424c-9cce-beccba0ae921 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:08.912696 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-98f3fb96-015d-424c-9cce-beccba0ae921 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1679 microversion: 2.1 time: 0.147950 May 19 15:13:08.913599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 389/775] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:08 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:08.976231 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ba96915c-1bae-4d88-a46a-8f302e11bed2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:08.976944 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ba96915c-1bae-4d88-a46a-8f302e11bed2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:08.982920 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ba96915c-1bae-4d88-a46a-8f302e11bed2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:08.983409 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ba96915c-1bae-4d88-a46a-8f302e11bed2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:08.984167 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ba96915c-1bae-4d88-a46a-8f302e11bed2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:08.984604 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ba96915c-1bae-4d88-a46a-8f302e11bed2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:09.122932 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ba96915c-1bae-4d88-a46a-8f302e11bed2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:09.131089 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ba96915c-1bae-4d88-a46a-8f302e11bed2 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1569 microversion: 2.1 time: 0.158787 May 19 15:13:09.131906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 387/776] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:08 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:09.931674 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fad6e5da-8ed6-4fb9-914c-af9b4ff5be59 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:09.933189 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fad6e5da-8ed6-4fb9-914c-af9b4ff5be59 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:09.941767 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fad6e5da-8ed6-4fb9-914c-af9b4ff5be59 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:09.942854 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fad6e5da-8ed6-4fb9-914c-af9b4ff5be59 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:09.943853 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fad6e5da-8ed6-4fb9-914c-af9b4ff5be59 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:09.944327 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fad6e5da-8ed6-4fb9-914c-af9b4ff5be59 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:10.099488 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fad6e5da-8ed6-4fb9-914c-af9b4ff5be59 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:10.108133 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fad6e5da-8ed6-4fb9-914c-af9b4ff5be59 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1656 microversion: 2.1 time: 0.182150 May 19 15:13:10.120944 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 390/777] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:09 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1656 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:10.127781 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3e7e7b61-374b-4c0e-b27f-8bfccdc84085 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:10.135085 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3e7e7b61-374b-4c0e-b27f-8bfccdc84085 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:10.135656 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3e7e7b61-374b-4c0e-b27f-8bfccdc84085 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:10.150953 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-58160131-c679-4673-aa5c-bbe08dfce821 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:10.152864 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-58160131-c679-4673-aa5c-bbe08dfce821 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:10.160844 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-58160131-c679-4673-aa5c-bbe08dfce821 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:10.161553 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-58160131-c679-4673-aa5c-bbe08dfce821 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:10.162730 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-58160131-c679-4673-aa5c-bbe08dfce821 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:10.163371 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-58160131-c679-4673-aa5c-bbe08dfce821 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:10.165509 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-3e7e7b61-374b-4c0e-b27f-8bfccdc84085 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Going to try to start instance {{(pid=117445) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 15:13:10.181548 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:10.222630 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-3e7e7b61-374b-4c0e-b27f-8bfccdc84085 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "POST /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/action" status: 202 len: 0 microversion: 2.1 time: 0.099010 May 19 15:13:10.224304 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 388/778] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 15:13:10 2022] POST /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:13:10.233249 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-faa609a4-1b78-40a2-b15b-b54957fb9efb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:10.234495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-faa609a4-1b78-40a2-b15b-b54957fb9efb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:10.242258 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-faa609a4-1b78-40a2-b15b-b54957fb9efb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:10.243267 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-faa609a4-1b78-40a2-b15b-b54957fb9efb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:10.244426 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-faa609a4-1b78-40a2-b15b-b54957fb9efb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:10.245063 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-faa609a4-1b78-40a2-b15b-b54957fb9efb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:10.347607 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-58160131-c679-4673-aa5c-bbe08dfce821 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:10.359971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-58160131-c679-4673-aa5c-bbe08dfce821 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1510 microversion: 2.1 time: 0.214661 May 19 15:13:10.360923 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 391/779] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:10 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:13:10.377257 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2259375c-bfe1-4618-bfd1-08feeabb15b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:10.377782 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2259375c-bfe1-4618-bfd1-08feeabb15b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:10.384023 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2259375c-bfe1-4618-bfd1-08feeabb15b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:10.384468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2259375c-bfe1-4618-bfd1-08feeabb15b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:10.385231 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2259375c-bfe1-4618-bfd1-08feeabb15b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:10.385838 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2259375c-bfe1-4618-bfd1-08feeabb15b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:10.428568 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-faa609a4-1b78-40a2-b15b-b54957fb9efb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:10.436550 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-faa609a4-1b78-40a2-b15b-b54957fb9efb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1665 microversion: 2.1 time: 0.207458 May 19 15:13:10.437327 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 389/780] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:10 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1665 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:10.475516 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2259375c-bfe1-4618-bfd1-08feeabb15b6 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "POST /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc/action" status: 202 len: 0 microversion: 2.1 time: 0.096846 May 19 15:13:10.475516 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 392/781] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 15:13:10 2022] POST /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 15:13:10.480458 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4ff5f9b1-10cf-4cfe-87bc-a21d012ec6ad tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:10.481089 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4ff5f9b1-10cf-4cfe-87bc-a21d012ec6ad tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:10.492075 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4ff5f9b1-10cf-4cfe-87bc-a21d012ec6ad tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:10.492701 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4ff5f9b1-10cf-4cfe-87bc-a21d012ec6ad tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:10.493496 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4ff5f9b1-10cf-4cfe-87bc-a21d012ec6ad tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:10.493950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4ff5f9b1-10cf-4cfe-87bc-a21d012ec6ad tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:10.709554 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4ff5f9b1-10cf-4cfe-87bc-a21d012ec6ad tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:10.719600 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4ff5f9b1-10cf-4cfe-87bc-a21d012ec6ad tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1518 microversion: 2.1 time: 0.243126 May 19 15:13:10.720188 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 390/782] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:10 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1518 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:11.454424 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-bb709874-9288-4a06-ab84-4b07ba1a439b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:11.455163 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bb709874-9288-4a06-ab84-4b07ba1a439b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:11.461803 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bb709874-9288-4a06-ab84-4b07ba1a439b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:11.462335 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bb709874-9288-4a06-ab84-4b07ba1a439b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:11.463129 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bb709874-9288-4a06-ab84-4b07ba1a439b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:11.463585 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bb709874-9288-4a06-ab84-4b07ba1a439b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:11.595362 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-bb709874-9288-4a06-ab84-4b07ba1a439b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:11.603700 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-bb709874-9288-4a06-ab84-4b07ba1a439b tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1665 microversion: 2.1 time: 0.153528 May 19 15:13:11.604318 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 393/783] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:11 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:11.740989 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-830b1e05-3511-4aff-b29a-b574f6943471 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:11.741609 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-830b1e05-3511-4aff-b29a-b574f6943471 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:11.748878 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-830b1e05-3511-4aff-b29a-b574f6943471 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:11.749282 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-830b1e05-3511-4aff-b29a-b574f6943471 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:11.750056 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-830b1e05-3511-4aff-b29a-b574f6943471 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:11.750500 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-830b1e05-3511-4aff-b29a-b574f6943471 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:11.995273 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-830b1e05-3511-4aff-b29a-b574f6943471 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:12.007051 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-830b1e05-3511-4aff-b29a-b574f6943471 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1520 microversion: 2.1 time: 0.270329 May 19 15:13:12.007960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 391/784] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:11 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:12.035560 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-f42356ec-e424-4695-b0e5-4dd65f385ad2 req-802d4b19-1d10-430d-a190-31f7b9244c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d166a7-9804-44f0-8e9a-a901a6a29cdc", "name": "network-vif-unplugged", "status": "completed", "tag": "5a44dc9e-4dbb-4932-b730-880e5d1f89e8"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:12.049032 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-f42356ec-e424-4695-b0e5-4dd65f385ad2 req-802d4b19-1d10-430d-a190-31f7b9244c3a service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:12.050047 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-f42356ec-e424-4695-b0e5-4dd65f385ad2 req-802d4b19-1d10-430d-a190-31f7b9244c3a service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:12.066457 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.compute.server_external_events [req-f42356ec-e424-4695-b0e5-4dd65f385ad2 req-802d4b19-1d10-430d-a190-31f7b9244c3a service nova] Unable to find a host for instance 81d166a7-9804-44f0-8e9a-a901a6a29cdc. Dropping event network-vif-unplugged {{(pid=117444) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 15:13:12.068464 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-f42356ec-e424-4695-b0e5-4dd65f385ad2 req-802d4b19-1d10-430d-a190-31f7b9244c3a service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038289 May 19 15:13:12.069742 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 394/785] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 15:13:12.621945 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-520d82bd-b40e-459b-b6ea-bc7e87e5db91 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:12.622666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-520d82bd-b40e-459b-b6ea-bc7e87e5db91 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:12.629945 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-520d82bd-b40e-459b-b6ea-bc7e87e5db91 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:12.630782 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-520d82bd-b40e-459b-b6ea-bc7e87e5db91 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:12.632273 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-520d82bd-b40e-459b-b6ea-bc7e87e5db91 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:12.632522 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-520d82bd-b40e-459b-b6ea-bc7e87e5db91 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:12.775261 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-520d82bd-b40e-459b-b6ea-bc7e87e5db91 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:12.784658 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-520d82bd-b40e-459b-b6ea-bc7e87e5db91 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1669 microversion: 2.1 time: 0.167161 May 19 15:13:12.786058 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 392/786] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:12 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:13.025484 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-40e5db92-d936-41c2-bc85-21445961bfec tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:13.026303 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-40e5db92-d936-41c2-bc85-21445961bfec tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:13.032867 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40e5db92-d936-41c2-bc85-21445961bfec tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:13.033329 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40e5db92-d936-41c2-bc85-21445961bfec tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:13.034101 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40e5db92-d936-41c2-bc85-21445961bfec tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:13.034542 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-40e5db92-d936-41c2-bc85-21445961bfec tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:13.038499 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:13.193931 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-40e5db92-d936-41c2-bc85-21445961bfec tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:13.202186 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-40e5db92-d936-41c2-bc85-21445961bfec tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1576 microversion: 2.1 time: 0.180491 May 19 15:13:13.203002 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 395/787] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:13 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:14.219558 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-fd4fa593-df5c-4b35-a083-f4210f3765a9 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:14.220109 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-fd4fa593-df5c-4b35-a083-f4210f3765a9 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:14.226702 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fd4fa593-df5c-4b35-a083-f4210f3765a9 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:14.227174 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fd4fa593-df5c-4b35-a083-f4210f3765a9 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:14.228071 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fd4fa593-df5c-4b35-a083-f4210f3765a9 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:14.228404 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fd4fa593-df5c-4b35-a083-f4210f3765a9 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:14.362960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-fd4fa593-df5c-4b35-a083-f4210f3765a9 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:14.371644 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-fd4fa593-df5c-4b35-a083-f4210f3765a9 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1576 microversion: 2.1 time: 0.156021 May 19 15:13:14.372209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 393/788] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:14 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:15.388473 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9927ad16-adb5-437f-a41b-f73a6cffc420 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:15.389088 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9927ad16-adb5-437f-a41b-f73a6cffc420 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:15.396006 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9927ad16-adb5-437f-a41b-f73a6cffc420 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:15.396460 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9927ad16-adb5-437f-a41b-f73a6cffc420 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:15.397226 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9927ad16-adb5-437f-a41b-f73a6cffc420 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:15.397655 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9927ad16-adb5-437f-a41b-f73a6cffc420 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:15.532753 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9927ad16-adb5-437f-a41b-f73a6cffc420 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:15.540630 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9927ad16-adb5-437f-a41b-f73a6cffc420 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1576 microversion: 2.1 time: 0.156087 May 19 15:13:15.541311 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 396/789] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:15 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:16.559023 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d5fac5bf-187c-4934-803f-4812d64d8b46 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:16.560017 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-d5fac5bf-187c-4934-803f-4812d64d8b46 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:16.567902 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d5fac5bf-187c-4934-803f-4812d64d8b46 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:16.568664 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d5fac5bf-187c-4934-803f-4812d64d8b46 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:16.569998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d5fac5bf-187c-4934-803f-4812d64d8b46 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:16.570772 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d5fac5bf-187c-4934-803f-4812d64d8b46 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:16.709763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-d5fac5bf-187c-4934-803f-4812d64d8b46 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:16.717903 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-d5fac5bf-187c-4934-803f-4812d64d8b46 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1576 microversion: 2.1 time: 0.163366 May 19 15:13:16.718472 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 394/790] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:16 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:17.735709 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9641e973-4b87-4831-9cf0-6206cef96b55 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:17.736468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9641e973-4b87-4831-9cf0-6206cef96b55 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:17.743988 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9641e973-4b87-4831-9cf0-6206cef96b55 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:17.744458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9641e973-4b87-4831-9cf0-6206cef96b55 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:17.745235 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9641e973-4b87-4831-9cf0-6206cef96b55 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:17.745672 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9641e973-4b87-4831-9cf0-6206cef96b55 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:17.881607 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9641e973-4b87-4831-9cf0-6206cef96b55 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:17.889178 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9641e973-4b87-4831-9cf0-6206cef96b55 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1576 microversion: 2.1 time: 0.157228 May 19 15:13:17.889751 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 397/791] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:17 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:18.906073 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-70784d7f-a70f-4401-bb55-01fea75dfd80 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:18.906721 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-70784d7f-a70f-4401-bb55-01fea75dfd80 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:18.913985 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-70784d7f-a70f-4401-bb55-01fea75dfd80 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:18.914490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-70784d7f-a70f-4401-bb55-01fea75dfd80 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:18.915376 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-70784d7f-a70f-4401-bb55-01fea75dfd80 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:18.915885 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-70784d7f-a70f-4401-bb55-01fea75dfd80 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:19.052302 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-70784d7f-a70f-4401-bb55-01fea75dfd80 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:19.060010 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-70784d7f-a70f-4401-bb55-01fea75dfd80 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1576 microversion: 2.1 time: 0.157781 May 19 15:13:19.060584 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 395/792] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:18 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:13:20.076387 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-aae7f734-8044-4351-ab3c-155b711bffa5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:20.076996 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-aae7f734-8044-4351-ab3c-155b711bffa5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:20.083738 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aae7f734-8044-4351-ab3c-155b711bffa5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:20.084187 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aae7f734-8044-4351-ab3c-155b711bffa5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:20.084939 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aae7f734-8044-4351-ab3c-155b711bffa5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:20.085370 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aae7f734-8044-4351-ab3c-155b711bffa5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:20.217294 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-aae7f734-8044-4351-ab3c-155b711bffa5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:20.224825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-aae7f734-8044-4351-ab3c-155b711bffa5 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1576 microversion: 2.1 time: 0.152223 May 19 15:13:20.231583 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 398/793] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:20 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:21.241930 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-edff6ceb-318c-4c7a-87bb-e9e91215b5fd tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:21.242541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-edff6ceb-318c-4c7a-87bb-e9e91215b5fd tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:21.249223 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-edff6ceb-318c-4c7a-87bb-e9e91215b5fd tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:21.249668 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-edff6ceb-318c-4c7a-87bb-e9e91215b5fd tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:21.250423 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-edff6ceb-318c-4c7a-87bb-e9e91215b5fd tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:21.250856 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-edff6ceb-318c-4c7a-87bb-e9e91215b5fd tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:21.382268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-edff6ceb-318c-4c7a-87bb-e9e91215b5fd tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:21.389858 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-edff6ceb-318c-4c7a-87bb-e9e91215b5fd tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1576 microversion: 2.1 time: 0.152337 May 19 15:13:21.390423 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 396/794] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:21 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:22.406878 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-941b5f02-7daa-4384-87be-903356035b1b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:22.407514 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-941b5f02-7daa-4384-87be-903356035b1b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:22.414710 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-941b5f02-7daa-4384-87be-903356035b1b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:22.415229 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-941b5f02-7daa-4384-87be-903356035b1b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:22.416007 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-941b5f02-7daa-4384-87be-903356035b1b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:22.416440 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-941b5f02-7daa-4384-87be-903356035b1b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:22.546139 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-941b5f02-7daa-4384-87be-903356035b1b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:22.554473 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-941b5f02-7daa-4384-87be-903356035b1b tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1576 microversion: 2.1 time: 0.151404 May 19 15:13:22.555039 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 399/795] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:22 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:22.847323 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-154336776", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1235658748", "security_groups": [{"name": "tempest-secgroup-smoke-1975589445"}], "block_device_mapping_v2": [{"uuid": "d4f6765e-30ec-4f94-bf1c-c91f7299a8ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c953f990-ab01-4a12-ad62-ff0b653ea46c"}]}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:22.961543 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.network.neutron [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] validate_networks() for [('c953f990-ab01-4a12-ad62-ff0b653ea46c', None, None, None, None, None)] {{(pid=117445) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:13:23.464810 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Flavor limits 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:13:23.465231 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Image limits 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:13:23.465746 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Flavor pref 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:13:23.466114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Image pref 0:0:0 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:13:23.466520 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.virt.hardware [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117445) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:13:23.477845 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:23.478419 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:23.479439 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:23.480032 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:23.499996 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Getting quotas for project 2c71bc8f0a164884bc0c046fd1e7faab. Resources: {'cores', 'instances', 'ram'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:13:23.505167 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Getting quotas for user 9877b9bbc14141bba21625fc8f1046d2 and project 2c71bc8f0a164884bc0c046fd1e7faab. Resources: {'cores', 'instances', 'ram'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:13:23.564664 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Going to run 1 instances... {{(pid=117445) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:13:23.566913 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d4f6765e-30ec-4f94-bf1c-c91f7299a8ef',volume_size=None,volume_type=None)] {{(pid=117445) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:13:23.571547 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-065e6deb-8668-4595-b684-68da16633993 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:23.572172 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-065e6deb-8668-4595-b684-68da16633993 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:23.579884 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-065e6deb-8668-4595-b684-68da16633993 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:23.580778 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-065e6deb-8668-4595-b684-68da16633993 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:23.581954 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-065e6deb-8668-4595-b684-68da16633993 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:23.582997 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-065e6deb-8668-4595-b684-68da16633993 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:23.703023 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4bf319ec-859b-415f-844d-9062447eb243 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.859568 May 19 15:13:23.704291 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 397/796] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:13:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:13:23.715125 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-42883731-fab4-4003-a2a1-326ea9537b9e tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:23.715888 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-42883731-fab4-4003-a2a1-326ea9537b9e tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:23.726814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-065e6deb-8668-4595-b684-68da16633993 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:23.735258 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-065e6deb-8668-4595-b684-68da16633993 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1576 microversion: 2.1 time: 0.167480 May 19 15:13:23.736344 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 400/797] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:23 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:23.775058 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-42883731-fab4-4003-a2a1-326ea9537b9e tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:23.781657 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-42883731-fab4-4003-a2a1-326ea9537b9e tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1094 microversion: 2.1 time: 0.070723 May 19 15:13:23.782384 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 398/798] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:23 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:13:24.071941 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-436d0204-c4bb-4080-a021-0fffdc56970a req-c77498e9-8c81-4833-9e5e-457151e7f97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d166a7-9804-44f0-8e9a-a901a6a29cdc", "name": "network-vif-plugged", "status": "completed", "tag": "5a44dc9e-4dbb-4932-b730-880e5d1f89e8"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:24.080584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-436d0204-c4bb-4080-a021-0fffdc56970a req-c77498e9-8c81-4833-9e5e-457151e7f97d service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:24.081163 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-436d0204-c4bb-4080-a021-0fffdc56970a req-c77498e9-8c81-4833-9e5e-457151e7f97d service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:24.093213 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-436d0204-c4bb-4080-a021-0fffdc56970a req-c77498e9-8c81-4833-9e5e-457151e7f97d service nova] Creating event network-vif-plugged:5a44dc9e-4dbb-4932-b730-880e5d1f89e8 for instance 81d166a7-9804-44f0-8e9a-a901a6a29cdc on hv-cinder-82549 May 19 15:13:24.099099 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-436d0204-c4bb-4080-a021-0fffdc56970a req-c77498e9-8c81-4833-9e5e-457151e7f97d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030508 May 19 15:13:24.099828 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 401/799] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:13:24.757772 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3088ce57-2cee-486a-b910-70ef9563d1f4 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:24.758500 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-3088ce57-2cee-486a-b910-70ef9563d1f4 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:24.768015 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3088ce57-2cee-486a-b910-70ef9563d1f4 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:24.768553 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3088ce57-2cee-486a-b910-70ef9563d1f4 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:24.769420 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3088ce57-2cee-486a-b910-70ef9563d1f4 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:24.769983 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3088ce57-2cee-486a-b910-70ef9563d1f4 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:24.800538 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-362b871f-6922-44a3-b095-07c871ded906 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:24.802356 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-362b871f-6922-44a3-b095-07c871ded906 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:24.809428 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-362b871f-6922-44a3-b095-07c871ded906 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:24.810096 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-362b871f-6922-44a3-b095-07c871ded906 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:24.811063 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-362b871f-6922-44a3-b095-07c871ded906 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:24.811558 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-362b871f-6922-44a3-b095-07c871ded906 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:24.978780 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-362b871f-6922-44a3-b095-07c871ded906 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:24.995774 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-362b871f-6922-44a3-b095-07c871ded906 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1200 microversion: 2.1 time: 0.200003 May 19 15:13:24.996602 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 402/800] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:24 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1200 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:13:25.045716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-3088ce57-2cee-486a-b910-70ef9563d1f4 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:25.054390 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-3088ce57-2cee-486a-b910-70ef9563d1f4 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1576 microversion: 2.1 time: 0.303755 May 19 15:13:25.055345 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 399/801] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:24 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1576 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:13:26.012616 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ca3c145a-f168-4c34-a6f8-7b4ccaa21200 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:26.013881 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ca3c145a-f168-4c34-a6f8-7b4ccaa21200 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:26.023673 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca3c145a-f168-4c34-a6f8-7b4ccaa21200 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:26.024665 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca3c145a-f168-4c34-a6f8-7b4ccaa21200 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:26.025517 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca3c145a-f168-4c34-a6f8-7b4ccaa21200 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:26.026127 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ca3c145a-f168-4c34-a6f8-7b4ccaa21200 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:26.073169 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7a55731a-b5d3-4aeb-ba02-419f964f0553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:26.073803 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7a55731a-b5d3-4aeb-ba02-419f964f0553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:26.083023 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a55731a-b5d3-4aeb-ba02-419f964f0553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:26.083320 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a55731a-b5d3-4aeb-ba02-419f964f0553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:26.085370 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a55731a-b5d3-4aeb-ba02-419f964f0553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:26.087373 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a55731a-b5d3-4aeb-ba02-419f964f0553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:26.421624 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7a55731a-b5d3-4aeb-ba02-419f964f0553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:26.430228 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7a55731a-b5d3-4aeb-ba02-419f964f0553 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1563 microversion: 2.1 time: 0.361489 May 19 15:13:26.434076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 400/802] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:26 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1563 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:13:26.446055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-ca3c145a-f168-4c34-a6f8-7b4ccaa21200 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:26.457934 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ca3c145a-f168-4c34-a6f8-7b4ccaa21200 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1278 microversion: 2.1 time: 0.448776 May 19 15:13:26.459020 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 403/803] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:26 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1278 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:26.978949 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-12b97ce1-1812-4846-bdfa-50b62e900749 req-9cb73c93-5a9e-4f2d-84b1-712c45049d0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0e40dd3-1bc8-4d72-a975-272c4b6c8b68", "tag": "ed53e5b3-4733-49ad-b67b-e85553de91fa"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:26.985787 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:27.018200 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-12b97ce1-1812-4846-bdfa-50b62e900749 req-9cb73c93-5a9e-4f2d-84b1-712c45049d0c service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:27.018200 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-12b97ce1-1812-4846-bdfa-50b62e900749 req-9cb73c93-5a9e-4f2d-84b1-712c45049d0c service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:27.033596 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-12b97ce1-1812-4846-bdfa-50b62e900749 req-9cb73c93-5a9e-4f2d-84b1-712c45049d0c service nova] Creating event network-changed:ed53e5b3-4733-49ad-b67b-e85553de91fa for instance f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 on hv-cinder-82549 May 19 15:13:27.039519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-12b97ce1-1812-4846-bdfa-50b62e900749 req-9cb73c93-5a9e-4f2d-84b1-712c45049d0c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066791 May 19 15:13:27.041256 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 401/804] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:13:27.474937 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3e15a90b-788c-48ea-ac1d-ee2286dbdad4 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:27.475585 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3e15a90b-788c-48ea-ac1d-ee2286dbdad4 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:27.477977 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=53 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:27.483634 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e15a90b-788c-48ea-ac1d-ee2286dbdad4 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:27.484099 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e15a90b-788c-48ea-ac1d-ee2286dbdad4 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:27.484870 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e15a90b-788c-48ea-ac1d-ee2286dbdad4 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:27.485313 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3e15a90b-788c-48ea-ac1d-ee2286dbdad4 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:27.620094 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3e15a90b-788c-48ea-ac1d-ee2286dbdad4 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:27.627644 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3e15a90b-788c-48ea-ac1d-ee2286dbdad4 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1266 microversion: 2.1 time: 0.156638 May 19 15:13:27.628211 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 404/805] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:27 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:28.646854 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-65cba2e8-62bc-47d1-8d30-80fdc7393258 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:28.647612 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-65cba2e8-62bc-47d1-8d30-80fdc7393258 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:28.653771 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-65cba2e8-62bc-47d1-8d30-80fdc7393258 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:28.654226 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-65cba2e8-62bc-47d1-8d30-80fdc7393258 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:28.654983 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-65cba2e8-62bc-47d1-8d30-80fdc7393258 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:28.655454 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-65cba2e8-62bc-47d1-8d30-80fdc7393258 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:28.796198 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-65cba2e8-62bc-47d1-8d30-80fdc7393258 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:28.804991 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-65cba2e8-62bc-47d1-8d30-80fdc7393258 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1266 microversion: 2.1 time: 0.163662 May 19 15:13:28.805602 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 402/806] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:28 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:29.823040 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5c3a7cad-3cc9-4b60-b982-98b7aea694b6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:29.823677 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5c3a7cad-3cc9-4b60-b982-98b7aea694b6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:29.830333 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5c3a7cad-3cc9-4b60-b982-98b7aea694b6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:29.830799 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5c3a7cad-3cc9-4b60-b982-98b7aea694b6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:29.831688 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5c3a7cad-3cc9-4b60-b982-98b7aea694b6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:29.832771 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5c3a7cad-3cc9-4b60-b982-98b7aea694b6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:29.964149 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-5c3a7cad-3cc9-4b60-b982-98b7aea694b6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:29.971623 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5c3a7cad-3cc9-4b60-b982-98b7aea694b6 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1266 microversion: 2.1 time: 0.152277 May 19 15:13:29.972206 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 405/807] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:29 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:30.989419 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a404a23b-2423-4f09-8e0e-5c8008b359ae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:30.990057 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-a404a23b-2423-4f09-8e0e-5c8008b359ae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:30.997468 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a404a23b-2423-4f09-8e0e-5c8008b359ae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:30.997921 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a404a23b-2423-4f09-8e0e-5c8008b359ae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:30.998731 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a404a23b-2423-4f09-8e0e-5c8008b359ae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:30.999223 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a404a23b-2423-4f09-8e0e-5c8008b359ae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:31.140046 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-a404a23b-2423-4f09-8e0e-5c8008b359ae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:31.149173 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-a404a23b-2423-4f09-8e0e-5c8008b359ae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1266 microversion: 2.1 time: 0.164298 May 19 15:13:31.149851 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 403/808] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:30 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:32.166166 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c6cd6376-0b54-44fb-8f7c-44ff4403001f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:32.166785 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c6cd6376-0b54-44fb-8f7c-44ff4403001f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:32.173497 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c6cd6376-0b54-44fb-8f7c-44ff4403001f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:32.173950 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c6cd6376-0b54-44fb-8f7c-44ff4403001f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:32.174719 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c6cd6376-0b54-44fb-8f7c-44ff4403001f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:32.175168 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c6cd6376-0b54-44fb-8f7c-44ff4403001f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:32.314864 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c6cd6376-0b54-44fb-8f7c-44ff4403001f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:32.322987 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c6cd6376-0b54-44fb-8f7c-44ff4403001f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1266 microversion: 2.1 time: 0.160578 May 19 15:13:32.323535 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 406/809] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:32 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:33.340535 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-88aa3c7b-11b0-4d20-91b8-c928cc8bf2ff tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:33.341153 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-88aa3c7b-11b0-4d20-91b8-c928cc8bf2ff tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:33.347695 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-88aa3c7b-11b0-4d20-91b8-c928cc8bf2ff tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:33.348597 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-88aa3c7b-11b0-4d20-91b8-c928cc8bf2ff tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:33.349360 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-88aa3c7b-11b0-4d20-91b8-c928cc8bf2ff tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:33.349817 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-88aa3c7b-11b0-4d20-91b8-c928cc8bf2ff tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:33.482200 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-88aa3c7b-11b0-4d20-91b8-c928cc8bf2ff tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:33.489444 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=2 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:33.492548 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-88aa3c7b-11b0-4d20-91b8-c928cc8bf2ff tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1266 microversion: 2.1 time: 0.156016 May 19 15:13:33.493451 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 404/810] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:33 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:34.510846 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1c1d47cb-eb8c-404a-bdb8-08bd3c644aae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:34.511728 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1c1d47cb-eb8c-404a-bdb8-08bd3c644aae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:34.519765 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c1d47cb-eb8c-404a-bdb8-08bd3c644aae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:34.521031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c1d47cb-eb8c-404a-bdb8-08bd3c644aae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:34.522121 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c1d47cb-eb8c-404a-bdb8-08bd3c644aae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:34.522567 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1c1d47cb-eb8c-404a-bdb8-08bd3c644aae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:34.665644 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1c1d47cb-eb8c-404a-bdb8-08bd3c644aae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:34.674482 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1c1d47cb-eb8c-404a-bdb8-08bd3c644aae tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1266 microversion: 2.1 time: 0.168104 May 19 15:13:34.675116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 407/811] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:34 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:35.688809 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=8 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:35.696435 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-2b5a2381-1d51-456f-b30e-51d848eae67d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:35.697248 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-2b5a2381-1d51-456f-b30e-51d848eae67d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:35.704109 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2b5a2381-1d51-456f-b30e-51d848eae67d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:35.704656 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2b5a2381-1d51-456f-b30e-51d848eae67d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:35.705503 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2b5a2381-1d51-456f-b30e-51d848eae67d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:35.706012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2b5a2381-1d51-456f-b30e-51d848eae67d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:35.845029 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-2b5a2381-1d51-456f-b30e-51d848eae67d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:35.852574 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-2b5a2381-1d51-456f-b30e-51d848eae67d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1266 microversion: 2.1 time: 0.164943 May 19 15:13:35.861930 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 405/812] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:35 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:36.296819 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-186c159e-8212-45fe-9237-d1e18ce1e82d req-eac372b8-51f9-43a0-b301-18aef44dcc58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e40dd3-1bc8-4d72-a975-272c4b6c8b68", "name": "network-vif-plugged", "status": "completed", "tag": "ed53e5b3-4733-49ad-b67b-e85553de91fa"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:36.319497 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-186c159e-8212-45fe-9237-d1e18ce1e82d req-eac372b8-51f9-43a0-b301-18aef44dcc58 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:36.320135 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-186c159e-8212-45fe-9237-d1e18ce1e82d req-eac372b8-51f9-43a0-b301-18aef44dcc58 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:36.332323 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-186c159e-8212-45fe-9237-d1e18ce1e82d req-eac372b8-51f9-43a0-b301-18aef44dcc58 service nova] Creating event network-vif-plugged:ed53e5b3-4733-49ad-b67b-e85553de91fa for instance f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 on hv-cinder-82549 May 19 15:13:36.337631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-186c159e-8212-45fe-9237-d1e18ce1e82d req-eac372b8-51f9-43a0-b301-18aef44dcc58 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044647 May 19 15:13:36.338473 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 408/813] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:13:36.869855 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-cef7976e-d133-49e3-b1cc-de75e4619013 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:36.870390 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-cef7976e-d133-49e3-b1cc-de75e4619013 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:36.877950 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cef7976e-d133-49e3-b1cc-de75e4619013 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:36.878396 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cef7976e-d133-49e3-b1cc-de75e4619013 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:36.879160 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cef7976e-d133-49e3-b1cc-de75e4619013 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:36.879619 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cef7976e-d133-49e3-b1cc-de75e4619013 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:37.016981 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-cef7976e-d133-49e3-b1cc-de75e4619013 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:37.020393 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:37.025264 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-cef7976e-d133-49e3-b1cc-de75e4619013 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1266 microversion: 2.1 time: 0.159592 May 19 15:13:37.025823 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 406/814] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:36 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:37.214552 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1225843163", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "networks": [{"uuid": "9970d259-a5f7-4033-bd5b-efe5eef35ae2"}]}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:37.272524 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] validate_networks() for [('9970d259-a5f7-4033-bd5b-efe5eef35ae2', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:13:37.837982 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:13:37.838587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:13:37.838865 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:13:37.839335 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:13:37.839746 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:13:37.849537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:37.849975 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:37.850837 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:37.851303 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:37.874530 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Getting quotas for project 5818d7e3ac5946d9a461cabd216feeee. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:13:37.880375 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Getting quotas for user c8876815343540c284561a0e308cb6e9 and project 5818d7e3ac5946d9a461cabd216feeee. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:13:37.894325 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:13:37.897631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:13:37.942082 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d43ca986-777b-4d55-b318-891ea674fdcf tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731426 May 19 15:13:37.942728 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 409/815] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:13:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:13:37.953145 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b19b2db2-604d-47f1-85f7-23b66352e4c3 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:37.953760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b19b2db2-604d-47f1-85f7-23b66352e4c3 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:38.010933 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-b19b2db2-604d-47f1-85f7-23b66352e4c3 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:38.017592 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-b19b2db2-604d-47f1-85f7-23b66352e4c3 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 200 len: 1214 microversion: 2.1 time: 0.068972 May 19 15:13:38.018162 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 407/816] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:37 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:38.042204 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f25c37b7-1604-4bfd-bb22-2644874b4e4e tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:38.042995 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f25c37b7-1604-4bfd-bb22-2644874b4e4e tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:38.049647 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f25c37b7-1604-4bfd-bb22-2644874b4e4e tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:38.050109 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f25c37b7-1604-4bfd-bb22-2644874b4e4e tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:38.050920 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f25c37b7-1604-4bfd-bb22-2644874b4e4e tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:38.051901 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f25c37b7-1604-4bfd-bb22-2644874b4e4e tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:38.224385 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-f25c37b7-1604-4bfd-bb22-2644874b4e4e tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:38.239333 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f25c37b7-1604-4bfd-bb22-2644874b4e4e tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1452 microversion: 2.1 time: 0.200541 May 19 15:13:38.240639 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 410/817] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:38 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1452 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:38.256155 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6111f1d8-6678-4486-88ec-d657f488ebc0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:38.256863 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-6111f1d8-6678-4486-88ec-d657f488ebc0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:38.263635 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6111f1d8-6678-4486-88ec-d657f488ebc0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:38.264314 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6111f1d8-6678-4486-88ec-d657f488ebc0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:38.265290 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6111f1d8-6678-4486-88ec-d657f488ebc0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:38.265714 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6111f1d8-6678-4486-88ec-d657f488ebc0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:38.405620 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6111f1d8-6678-4486-88ec-d657f488ebc0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:38.414689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6111f1d8-6678-4486-88ec-d657f488ebc0 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1452 microversion: 2.1 time: 0.162534 May 19 15:13:38.416480 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 408/818] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:38 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:39.034483 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c16d9e54-88c0-49cf-a918-5399015a29c8 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:39.035243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c16d9e54-88c0-49cf-a918-5399015a29c8 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:39.041756 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c16d9e54-88c0-49cf-a918-5399015a29c8 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:39.042212 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c16d9e54-88c0-49cf-a918-5399015a29c8 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:39.042988 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c16d9e54-88c0-49cf-a918-5399015a29c8 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:39.043455 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c16d9e54-88c0-49cf-a918-5399015a29c8 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:39.129714 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c16d9e54-88c0-49cf-a918-5399015a29c8 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:39.148949 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c16d9e54-88c0-49cf-a918-5399015a29c8 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 200 len: 1266 microversion: 2.1 time: 0.118184 May 19 15:13:39.150830 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 411/819] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:39 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:40.115911 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-105e2d0e-f15f-4ea4-b023-edadc75a5d1e req-e65ea2c7-34c9-4fbc-84ec-b1de6e83d596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0e40dd3-1bc8-4d72-a975-272c4b6c8b68", "tag": "ed53e5b3-4733-49ad-b67b-e85553de91fa"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:40.125613 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-105e2d0e-f15f-4ea4-b023-edadc75a5d1e req-e65ea2c7-34c9-4fbc-84ec-b1de6e83d596 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:40.126088 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-105e2d0e-f15f-4ea4-b023-edadc75a5d1e req-e65ea2c7-34c9-4fbc-84ec-b1de6e83d596 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:40.140024 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-105e2d0e-f15f-4ea4-b023-edadc75a5d1e req-e65ea2c7-34c9-4fbc-84ec-b1de6e83d596 service nova] Creating event network-changed:ed53e5b3-4733-49ad-b67b-e85553de91fa for instance f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 on hv-cinder-82549 May 19 15:13:40.145889 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-105e2d0e-f15f-4ea4-b023-edadc75a5d1e req-e65ea2c7-34c9-4fbc-84ec-b1de6e83d596 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034017 May 19 15:13:40.147544 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 409/820] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:13:40.168256 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-dd2c9844-e895-4de9-aac2-4974957715b2 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:40.170028 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-dd2c9844-e895-4de9-aac2-4974957715b2 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:40.177918 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd2c9844-e895-4de9-aac2-4974957715b2 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:40.178815 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd2c9844-e895-4de9-aac2-4974957715b2 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:40.179808 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd2c9844-e895-4de9-aac2-4974957715b2 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:40.180522 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-dd2c9844-e895-4de9-aac2-4974957715b2 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:40.340968 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-dd2c9844-e895-4de9-aac2-4974957715b2 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:40.349236 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-dd2c9844-e895-4de9-aac2-4974957715b2 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 200 len: 1314 microversion: 2.1 time: 0.185732 May 19 15:13:40.349812 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 412/821] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:40 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:13:40.817487 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-fde66d94-917b-4321-b42c-54256c0ef89e req-efea7cb4-2bc6-41d6-845f-143a15db9a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55253db0-c8df-4d96-ae80-00f24074725d", "tag": "52828364-12da-467a-9428-1ce955174708"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:40.826523 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-fde66d94-917b-4321-b42c-54256c0ef89e req-efea7cb4-2bc6-41d6-845f-143a15db9a62 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:40.827432 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-fde66d94-917b-4321-b42c-54256c0ef89e req-efea7cb4-2bc6-41d6-845f-143a15db9a62 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:40.841231 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-fde66d94-917b-4321-b42c-54256c0ef89e req-efea7cb4-2bc6-41d6-845f-143a15db9a62 service nova] Creating event network-changed:52828364-12da-467a-9428-1ce955174708 for instance 55253db0-c8df-4d96-ae80-00f24074725d on hv-cinder-82549 May 19 15:13:40.850031 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-fde66d94-917b-4321-b42c-54256c0ef89e req-efea7cb4-2bc6-41d6-845f-143a15db9a62 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036632 May 19 15:13:40.851376 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 410/822] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:13:41.365964 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e0fcf47c-e583-4cfd-a0d2-439a186370e7 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:41.366577 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e0fcf47c-e583-4cfd-a0d2-439a186370e7 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:41.373393 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e0fcf47c-e583-4cfd-a0d2-439a186370e7 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:41.373848 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e0fcf47c-e583-4cfd-a0d2-439a186370e7 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:41.374612 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e0fcf47c-e583-4cfd-a0d2-439a186370e7 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:41.375052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e0fcf47c-e583-4cfd-a0d2-439a186370e7 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:41.505413 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e0fcf47c-e583-4cfd-a0d2-439a186370e7 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:41.509318 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=100 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:41.514285 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e0fcf47c-e583-4cfd-a0d2-439a186370e7 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 200 len: 1314 microversion: 2.1 time: 0.152585 May 19 15:13:41.515118 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 413/823] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:41 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:42.532675 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-919bcd52-6768-4d64-b988-a5d4c45c27ab tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:42.533377 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-919bcd52-6768-4d64-b988-a5d4c45c27ab tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:42.539590 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-919bcd52-6768-4d64-b988-a5d4c45c27ab tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:42.540043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-919bcd52-6768-4d64-b988-a5d4c45c27ab tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:42.540805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-919bcd52-6768-4d64-b988-a5d4c45c27ab tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:42.541243 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-919bcd52-6768-4d64-b988-a5d4c45c27ab tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:42.666907 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-919bcd52-6768-4d64-b988-a5d4c45c27ab tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:42.674461 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-919bcd52-6768-4d64-b988-a5d4c45c27ab tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 200 len: 1314 microversion: 2.1 time: 0.146527 May 19 15:13:42.675033 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 411/824] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:42 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:43.690766 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-aa5e1c94-ff4b-4cc0-ba5e-8e3f5c7cd767 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:43.691482 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-aa5e1c94-ff4b-4cc0-ba5e-8e3f5c7cd767 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:43.698059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aa5e1c94-ff4b-4cc0-ba5e-8e3f5c7cd767 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:43.698513 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aa5e1c94-ff4b-4cc0-ba5e-8e3f5c7cd767 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:43.699296 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aa5e1c94-ff4b-4cc0-ba5e-8e3f5c7cd767 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:43.699736 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aa5e1c94-ff4b-4cc0-ba5e-8e3f5c7cd767 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:43.992889 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-aa5e1c94-ff4b-4cc0-ba5e-8e3f5c7cd767 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:44.000542 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-aa5e1c94-ff4b-4cc0-ba5e-8e3f5c7cd767 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 200 len: 1314 microversion: 2.1 time: 0.313598 May 19 15:13:44.001123 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 414/825] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:43 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:45.016893 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-cb8ab909-8651-4b57-a7ee-cd0a014f7517 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:45.017577 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-cb8ab909-8651-4b57-a7ee-cd0a014f7517 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:45.024766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cb8ab909-8651-4b57-a7ee-cd0a014f7517 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:45.025222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cb8ab909-8651-4b57-a7ee-cd0a014f7517 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:45.025992 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cb8ab909-8651-4b57-a7ee-cd0a014f7517 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:45.026435 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cb8ab909-8651-4b57-a7ee-cd0a014f7517 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:45.158889 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-cb8ab909-8651-4b57-a7ee-cd0a014f7517 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:45.166356 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-cb8ab909-8651-4b57-a7ee-cd0a014f7517 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 200 len: 1314 microversion: 2.1 time: 0.153395 May 19 15:13:45.166922 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 412/826] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:45 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:46.138686 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-d600fb03-bd5c-4128-9735-753a5737910a req-b4019551-6120-4e15-8c43-82d75f8463f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55253db0-c8df-4d96-ae80-00f24074725d", "name": "network-vif-plugged", "status": "completed", "tag": "52828364-12da-467a-9428-1ce955174708"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:46.147293 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-d600fb03-bd5c-4128-9735-753a5737910a req-b4019551-6120-4e15-8c43-82d75f8463f4 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:46.147744 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-d600fb03-bd5c-4128-9735-753a5737910a req-b4019551-6120-4e15-8c43-82d75f8463f4 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:46.158984 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-d600fb03-bd5c-4128-9735-753a5737910a req-b4019551-6120-4e15-8c43-82d75f8463f4 service nova] Creating event network-vif-plugged:52828364-12da-467a-9428-1ce955174708 for instance 55253db0-c8df-4d96-ae80-00f24074725d on hv-cinder-82549 May 19 15:13:46.163839 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-d600fb03-bd5c-4128-9735-753a5737910a req-b4019551-6120-4e15-8c43-82d75f8463f4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028787 May 19 15:13:46.164414 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 415/827] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:13:46.183700 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-68b460a1-0efb-45fa-af81-fcc933cdd072 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:46.184319 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-68b460a1-0efb-45fa-af81-fcc933cdd072 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:46.195133 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-68b460a1-0efb-45fa-af81-fcc933cdd072 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:46.199516 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-68b460a1-0efb-45fa-af81-fcc933cdd072 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:46.201051 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-68b460a1-0efb-45fa-af81-fcc933cdd072 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:46.201503 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-68b460a1-0efb-45fa-af81-fcc933cdd072 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:46.363019 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-68b460a1-0efb-45fa-af81-fcc933cdd072 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:46.371844 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-68b460a1-0efb-45fa-af81-fcc933cdd072 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 200 len: 1314 microversion: 2.1 time: 0.191900 May 19 15:13:46.372745 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 413/828] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:46 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:47.390788 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-d2e219d7-8e27-4bfb-a7e2-b2ac9aa13260 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:47.391562 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-d2e219d7-8e27-4bfb-a7e2-b2ac9aa13260 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:47.398495 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d2e219d7-8e27-4bfb-a7e2-b2ac9aa13260 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:47.398954 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d2e219d7-8e27-4bfb-a7e2-b2ac9aa13260 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:47.399777 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d2e219d7-8e27-4bfb-a7e2-b2ac9aa13260 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:47.400223 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-d2e219d7-8e27-4bfb-a7e2-b2ac9aa13260 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:47.530609 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-d2e219d7-8e27-4bfb-a7e2-b2ac9aa13260 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:47.538665 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-d2e219d7-8e27-4bfb-a7e2-b2ac9aa13260 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 200 len: 1314 microversion: 2.1 time: 0.152700 May 19 15:13:47.539251 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 416/829] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:47 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:48.555066 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d46d77bf-117f-42bb-945b-d5cb1523296c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:48.555708 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-d46d77bf-117f-42bb-945b-d5cb1523296c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:48.557756 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f56e0262-8137-4caa-971e-e4a4683ac92a tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:48.558165 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=2 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:48.558779 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f56e0262-8137-4caa-971e-e4a4683ac92a tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:48.560642 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:48.561302 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:48.563763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d46d77bf-117f-42bb-945b-d5cb1523296c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:48.564216 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d46d77bf-117f-42bb-945b-d5cb1523296c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:48.564986 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d46d77bf-117f-42bb-945b-d5cb1523296c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:48.565435 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d46d77bf-117f-42bb-945b-d5cb1523296c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:48.568034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f56e0262-8137-4caa-971e-e4a4683ac92a tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:48.568488 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f56e0262-8137-4caa-971e-e4a4683ac92a tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:48.569263 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f56e0262-8137-4caa-971e-e4a4683ac92a tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:48.569702 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f56e0262-8137-4caa-971e-e4a4683ac92a tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:48.598506 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f56e0262-8137-4caa-971e-e4a4683ac92a tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044569 May 19 15:13:48.599288 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 417/830] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:13:48 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 15:13:48.657881 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-48acb8e5-e3f6-4115-a8f5-dce211a1cacd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:48.658383 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-48acb8e5-e3f6-4115-a8f5-dce211a1cacd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:48.664493 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-48acb8e5-e3f6-4115-a8f5-dce211a1cacd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:48.664952 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-48acb8e5-e3f6-4115-a8f5-dce211a1cacd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:48.665721 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-48acb8e5-e3f6-4115-a8f5-dce211a1cacd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:48.666160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-48acb8e5-e3f6-4115-a8f5-dce211a1cacd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:48.690519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-48acb8e5-e3f6-4115-a8f5-dce211a1cacd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:13:48.700104 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-d46d77bf-117f-42bb-945b-d5cb1523296c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:48.708249 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-d46d77bf-117f-42bb-945b-d5cb1523296c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 200 len: 1497 microversion: 2.1 time: 0.157055 May 19 15:13:48.708824 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 414/831] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:48 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:48.767456 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-48acb8e5-e3f6-4115-a8f5-dce211a1cacd tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 204 len: 0 microversion: 2.1 time: 0.112986 May 19 15:13:48.768045 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 418/832] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:13:48 2022] DELETE /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 15:13:48.778387 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-95a880a8-77d5-4a54-aaba-f06947a0bb85 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:48.779564 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-95a880a8-77d5-4a54-aaba-f06947a0bb85 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:48.786697 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-95a880a8-77d5-4a54-aaba-f06947a0bb85 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:48.787173 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-95a880a8-77d5-4a54-aaba-f06947a0bb85 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:48.787991 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-95a880a8-77d5-4a54-aaba-f06947a0bb85 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:48.788439 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-95a880a8-77d5-4a54-aaba-f06947a0bb85 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:48.921418 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-95a880a8-77d5-4a54-aaba-f06947a0bb85 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:48.929638 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-95a880a8-77d5-4a54-aaba-f06947a0bb85 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1675 microversion: 2.1 time: 0.156489 May 19 15:13:48.930296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 415/833] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:48 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:49.163028 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-32e793f2-902e-4668-a41d-fa90da028e03 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:49.163708 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-32e793f2-902e-4668-a41d-fa90da028e03 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:49.169876 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-32e793f2-902e-4668-a41d-fa90da028e03 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:49.170342 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-32e793f2-902e-4668-a41d-fa90da028e03 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:49.171112 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-32e793f2-902e-4668-a41d-fa90da028e03 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:49.171587 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-32e793f2-902e-4668-a41d-fa90da028e03 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:49.196180 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-32e793f2-902e-4668-a41d-fa90da028e03 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:13:49.271788 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-32e793f2-902e-4668-a41d-fa90da028e03 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "DELETE /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 204 len: 0 microversion: 2.1 time: 0.113353 May 19 15:13:49.272377 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 419/834] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:13:49 2022] DELETE /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:13:49.280486 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7228a919-30fd-4d2d-bd0a-c0dcf08ef365 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:49.281106 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7228a919-30fd-4d2d-bd0a-c0dcf08ef365 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:49.287053 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7228a919-30fd-4d2d-bd0a-c0dcf08ef365 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:49.287538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7228a919-30fd-4d2d-bd0a-c0dcf08ef365 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:49.288306 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7228a919-30fd-4d2d-bd0a-c0dcf08ef365 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:49.288744 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7228a919-30fd-4d2d-bd0a-c0dcf08ef365 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:49.418478 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7228a919-30fd-4d2d-bd0a-c0dcf08ef365 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:49.426030 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7228a919-30fd-4d2d-bd0a-c0dcf08ef365 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 200 len: 1503 microversion: 2.1 time: 0.149399 May 19 15:13:49.426659 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 416/835] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:49 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:49.947872 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8ff2c539-1495-4884-abab-9a348e8441cf tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:49.948580 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8ff2c539-1495-4884-abab-9a348e8441cf tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:49.954541 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ff2c539-1495-4884-abab-9a348e8441cf tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:49.955000 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ff2c539-1495-4884-abab-9a348e8441cf tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:49.955801 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ff2c539-1495-4884-abab-9a348e8441cf tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:49.956249 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8ff2c539-1495-4884-abab-9a348e8441cf tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:50.086482 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8ff2c539-1495-4884-abab-9a348e8441cf tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:50.093915 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8ff2c539-1495-4884-abab-9a348e8441cf tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1675 microversion: 2.1 time: 0.150329 May 19 15:13:50.094478 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 420/836] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:49 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:50.443141 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6e83e17d-2fed-4d50-b167-84e1137da35c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:50.444018 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-6e83e17d-2fed-4d50-b167-84e1137da35c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:50.450595 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6e83e17d-2fed-4d50-b167-84e1137da35c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:50.451053 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6e83e17d-2fed-4d50-b167-84e1137da35c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:50.451867 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6e83e17d-2fed-4d50-b167-84e1137da35c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:50.452313 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6e83e17d-2fed-4d50-b167-84e1137da35c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:50.580597 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6e83e17d-2fed-4d50-b167-84e1137da35c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:50.588640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6e83e17d-2fed-4d50-b167-84e1137da35c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 200 len: 1503 microversion: 2.1 time: 0.149429 May 19 15:13:50.589206 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 417/837] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:50 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:51.110865 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e1a97cef-7679-4179-873e-ea33826f02ed tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:51.111434 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e1a97cef-7679-4179-873e-ea33826f02ed tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:51.118616 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1a97cef-7679-4179-873e-ea33826f02ed tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:51.119066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1a97cef-7679-4179-873e-ea33826f02ed tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:51.119855 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1a97cef-7679-4179-873e-ea33826f02ed tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:51.120290 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e1a97cef-7679-4179-873e-ea33826f02ed tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:51.245272 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e1a97cef-7679-4179-873e-ea33826f02ed tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:51.252705 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e1a97cef-7679-4179-873e-ea33826f02ed tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1675 microversion: 2.1 time: 0.145778 May 19 15:13:51.253259 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 421/838] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:51 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:51.605867 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3dcef219-ac0e-46bc-a503-d43adb78c89d tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:51.606474 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-3dcef219-ac0e-46bc-a503-d43adb78c89d tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:51.612960 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3dcef219-ac0e-46bc-a503-d43adb78c89d tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:51.613412 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3dcef219-ac0e-46bc-a503-d43adb78c89d tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:51.614161 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3dcef219-ac0e-46bc-a503-d43adb78c89d tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:51.614627 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3dcef219-ac0e-46bc-a503-d43adb78c89d tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:51.741893 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-3dcef219-ac0e-46bc-a503-d43adb78c89d tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:51.749525 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-3dcef219-ac0e-46bc-a503-d43adb78c89d tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 200 len: 1503 microversion: 2.1 time: 0.147564 May 19 15:13:51.750085 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 418/839] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:51 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:52.269836 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-e560ce0c-0053-48ad-80c3-d5be5d5db036 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:52.270432 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-e560ce0c-0053-48ad-80c3-d5be5d5db036 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:52.276795 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e560ce0c-0053-48ad-80c3-d5be5d5db036 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:52.277251 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e560ce0c-0053-48ad-80c3-d5be5d5db036 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:52.278012 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e560ce0c-0053-48ad-80c3-d5be5d5db036 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:52.278446 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-e560ce0c-0053-48ad-80c3-d5be5d5db036 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:52.411039 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-e560ce0c-0053-48ad-80c3-d5be5d5db036 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:52.421397 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-e560ce0c-0053-48ad-80c3-d5be5d5db036 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1675 microversion: 2.1 time: 0.155402 May 19 15:13:52.421979 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 422/840] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:52 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:52.765916 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9ecb7859-0757-4936-b4d4-63d8d8fdf6a1 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:52.766535 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-9ecb7859-0757-4936-b4d4-63d8d8fdf6a1 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:52.773829 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9ecb7859-0757-4936-b4d4-63d8d8fdf6a1 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:52.774221 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9ecb7859-0757-4936-b4d4-63d8d8fdf6a1 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:52.774999 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9ecb7859-0757-4936-b4d4-63d8d8fdf6a1 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:52.775469 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9ecb7859-0757-4936-b4d4-63d8d8fdf6a1 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:52.909030 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9ecb7859-0757-4936-b4d4-63d8d8fdf6a1 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:52.917570 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9ecb7859-0757-4936-b4d4-63d8d8fdf6a1 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 200 len: 1503 microversion: 2.1 time: 0.155527 May 19 15:13:52.918161 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 419/841] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:52 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:53.435837 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-80130d75-3e1d-4155-b974-2a897c731786 req-9aada186-5dc9-47d5-9992-87148ef0483d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55253db0-c8df-4d96-ae80-00f24074725d", "name": "network-vif-deleted", "tag": "52828364-12da-467a-9428-1ce955174708"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:53.443356 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-468e6cd0-6910-4d05-b0d4-3245c7cccf52 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:53.443789 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-468e6cd0-6910-4d05-b0d4-3245c7cccf52 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:53.449958 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-80130d75-3e1d-4155-b974-2a897c731786 req-9aada186-5dc9-47d5-9992-87148ef0483d service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:53.450793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-468e6cd0-6910-4d05-b0d4-3245c7cccf52 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:53.451035 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-80130d75-3e1d-4155-b974-2a897c731786 req-9aada186-5dc9-47d5-9992-87148ef0483d service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:53.451255 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-468e6cd0-6910-4d05-b0d4-3245c7cccf52 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:53.452042 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-468e6cd0-6910-4d05-b0d4-3245c7cccf52 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:53.452620 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-468e6cd0-6910-4d05-b0d4-3245c7cccf52 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:53.477547 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-80130d75-3e1d-4155-b974-2a897c731786 req-9aada186-5dc9-47d5-9992-87148ef0483d service nova] Creating event network-vif-deleted:52828364-12da-467a-9428-1ce955174708 for instance 55253db0-c8df-4d96-ae80-00f24074725d on hv-cinder-82549 May 19 15:13:53.499408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-80130d75-3e1d-4155-b974-2a897c731786 req-9aada186-5dc9-47d5-9992-87148ef0483d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067793 May 19 15:13:53.500379 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 423/842] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:13:53.552364 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-468e6cd0-6910-4d05-b0d4-3245c7cccf52 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:53.560268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-468e6cd0-6910-4d05-b0d4-3245c7cccf52 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 200 len: 1607 microversion: 2.1 time: 0.122791 May 19 15:13:53.560848 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 420/843] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:53 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 1607 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:13:53.935592 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-35eb30ba-623c-458f-9765-aeedc0ef4b28 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:53.936328 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-35eb30ba-623c-458f-9765-aeedc0ef4b28 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:53.943485 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35eb30ba-623c-458f-9765-aeedc0ef4b28 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:53.944232 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35eb30ba-623c-458f-9765-aeedc0ef4b28 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:53.945240 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35eb30ba-623c-458f-9765-aeedc0ef4b28 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:53.945684 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35eb30ba-623c-458f-9765-aeedc0ef4b28 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:53.985692 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35eb30ba-623c-458f-9765-aeedc0ef4b28 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:53.986572 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-35eb30ba-623c-458f-9765-aeedc0ef4b28 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:53.987277 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-35eb30ba-623c-458f-9765-aeedc0ef4b28 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lazy-loading 'fault' on Instance uuid 55253db0-c8df-4d96-ae80-00f24074725d {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:13:54.062319 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-35eb30ba-623c-458f-9765-aeedc0ef4b28 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:54.069348 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-35eb30ba-623c-458f-9765-aeedc0ef4b28 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 200 len: 1304 microversion: 2.1 time: 0.138937 May 19 15:13:54.070134 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 424/844] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:53 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:54.577974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e481aaf7-9fdc-4d76-abe0-f2ed5bb8d876 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:54.578596 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e481aaf7-9fdc-4d76-abe0-f2ed5bb8d876 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:54.585379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e481aaf7-9fdc-4d76-abe0-f2ed5bb8d876 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:54.585836 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e481aaf7-9fdc-4d76-abe0-f2ed5bb8d876 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:54.586615 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e481aaf7-9fdc-4d76-abe0-f2ed5bb8d876 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:54.587058 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e481aaf7-9fdc-4d76-abe0-f2ed5bb8d876 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:54.601616 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-e481aaf7-9fdc-4d76-abe0-f2ed5bb8d876 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] HTTP exception thrown: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e481aaf7-9fdc-4d76-abe0-f2ed5bb8d876 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Request method failure captured: May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 HTTP/1.1 May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihl39CIi73st8uXzDKGjSW8XonfMbZs0-yWiJNjPJcAtENgCNq936kRMW-zc4wTwLcekaNDdKZGN-iCUghy30e9RBxTQLR2QFpJH6-l1XrZ5aRslL33Df3Wu6faBJQ09ia8QCcYep-PNk6PcEtM-zSlr7gYNh7HO972NvzTeRuV8jgLE May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 5b1521fd041a446e851d82487479930b May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-AttachVolumeTestJSON-428291670 May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:13:54.603351 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:13:54.604796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5b1521fd041a446e851d82487479930b", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5b1521fd041a446e851d82487479930b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5b1521fd041a446e851d82487479930b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5b1521fd041a446e851d82487479930b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:13:54.604796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-AttachVolumeTestJSON-428291670 May 19 15:13:54.604796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 5b1521fd041a446e851d82487479930b May 19 15:13:54.604796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-AttachVolumeTestJSON-428291670 May 19 15:13:54.604796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-AttachVolumeTestJSON-428291670-project May 19 15:13:54.604796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:13:54.604796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:13:54.604796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 0022fc1107834a5cbe30f0146361213b May 19 15:13:54.604796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-AttachVolumeTestJSON-428291670-project May 19 15:13:54.604796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:13:54.604796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. May 19 15:13:54.604796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': 'f20c74e3-1f32-4118-b98b-2e60725d9ea2'} May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:13:54.605717 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. May 19 15:13:54.607016 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:13:54.608201 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e481aaf7-9fdc-4d76-abe0-f2ed5bb8d876 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Returning 404 to user: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:13:54.608201 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e481aaf7-9fdc-4d76-abe0-f2ed5bb8d876 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 404 len: 111 microversion: 2.1 time: 0.030772 May 19 15:13:54.608201 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 421/845] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:54 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:13:54.614226 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a38774bf-5687-476c-9d1e-85ad77f68dd1 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '.version_select at 0x7f35d1204670>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:54.632686 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a38774bf-5687-476c-9d1e-85ad77f68dd1 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866684903" status: 202 len: 0 microversion: 2.1 time: 0.022750 May 19 15:13:54.633260 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 425/846] 10.222.0.24 () {58 vars in 1220 bytes} [Thu May 19 15:13:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1866684903 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:13:55.088866 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-bd3957f3-24ab-4f76-9f56-8362c94a8654 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:55.089486 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-bd3957f3-24ab-4f76-9f56-8362c94a8654 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 55253db0-c8df-4d96-ae80-00f24074725d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:55.095512 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-bd3957f3-24ab-4f76-9f56-8362c94a8654 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:55.095969 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-bd3957f3-24ab-4f76-9f56-8362c94a8654 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:55.096760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-bd3957f3-24ab-4f76-9f56-8362c94a8654 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:55.097172 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-bd3957f3-24ab-4f76-9f56-8362c94a8654 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:55.110924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-bd3957f3-24ab-4f76-9f56-8362c94a8654 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] HTTP exception thrown: Instance 55253db0-c8df-4d96-ae80-00f24074725d could not be found. May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-bd3957f3-24ab-4f76-9f56-8362c94a8654 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Request method failure captured: May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d HTTP/1.1 May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihl6fe1nEq8jyXVJd6Sgbpa7TGb89mA7BDS7ic2St4XLJFPM-1BNEObu9ZYS328LE75clNp6zMtuCwVeJ-d3UaqCW-gzzb3-WQ8GT92BpjttNHwdlCju5AKd_uf_sLAclQZOHTwQmngi8xtO70kAHaxx4FnaY5erp8DrXklDg1oFwiT4 May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 5818d7e3ac5946d9a461cabd216feeee May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-VolumesActionsTest-2067223529 May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:13:55.112518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:13:55.114114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5818d7e3ac5946d9a461cabd216feeee", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5818d7e3ac5946d9a461cabd216feeee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5818d7e3ac5946d9a461cabd216feeee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5818d7e3ac5946d9a461cabd216feeee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:13:55.114114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-VolumesActionsTest-2067223529 May 19 15:13:55.114114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 5818d7e3ac5946d9a461cabd216feeee May 19 15:13:55.114114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-VolumesActionsTest-2067223529 May 19 15:13:55.114114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-VolumesActionsTest-2067223529-project May 19 15:13:55.114114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:13:55.114114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:13:55.114114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: c8876815343540c284561a0e308cb6e9 May 19 15:13:55.114114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-VolumesActionsTest-2067223529-project May 19 15:13:55.114114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:13:55.114114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 55253db0-c8df-4d96-ae80-00f24074725d could not be found. May 19 15:13:55.114114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '55253db0-c8df-4d96-ae80-00f24074725d'} May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55253db0-c8df-4d96-ae80-00f24074725d could not be found. May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:13:55.114971 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55253db0-c8df-4d96-ae80-00f24074725d could not be found. May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55253db0-c8df-4d96-ae80-00f24074725d could not be found. May 19 15:13:55.116218 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:13:55.117666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-bd3957f3-24ab-4f76-9f56-8362c94a8654 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Returning 404 to user: Instance 55253db0-c8df-4d96-ae80-00f24074725d could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:13:55.117666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-bd3957f3-24ab-4f76-9f56-8362c94a8654 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d" status: 404 len: 111 microversion: 2.1 time: 0.031969 May 19 15:13:55.117666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 422/847] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:55 2022] GET /compute/v2.1/servers/55253db0-c8df-4d96-ae80-00f24074725d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:13:55.167108 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1498268632", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "networks": [{"uuid": "9970d259-a5f7-4033-bd5b-efe5eef35ae2"}]}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:55.220953 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] validate_networks() for [('9970d259-a5f7-4033-bd5b-efe5eef35ae2', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:13:55.246407 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-85b7669e-c57a-48a3-845d-3fd65a13f8a9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Action: 'create', calling method: .version_select at 0x7f35d131faf0>, body: {"keypair": {"name": "tempest-keypair-270324715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3Oq+C5UaQFH5Sa+fBHesHd/VAirt5jvLOrJ4ftTzY5CDLx65Pbzajxp863ZWyV22C1XzStOzaTaUxAaZe15Tqpb8fCilabtJmHPtwIYDqTLxYej6nWoYbQ9J72B+oTPw=="}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:55.261880 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-85b7669e-c57a-48a3-845d-3fd65a13f8a9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Getting quotas for project 5b1521fd041a446e851d82487479930b. Resources: {'key_pairs'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:13:55.265832 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-85b7669e-c57a-48a3-845d-3fd65a13f8a9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Getting quotas for user 0022fc1107834a5cbe30f0146361213b and project 5b1521fd041a446e851d82487479930b. Resources: {'key_pairs'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:13:55.289765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-85b7669e-c57a-48a3-845d-3fd65a13f8a9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048160 May 19 15:13:55.290867 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 423/848] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 15:13:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:13:55.542791 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-117ec337-6249-4772-9909-cbc0798958f1 req-47104d7d-8333-4cd4-8af1-71f3cad38795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20c74e3-1f32-4118-b98b-2e60725d9ea2", "name": "network-vif-deleted", "tag": "ccdc4c36-ce1d-470e-9208-6ea0c0ff6e38"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:55.551760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-117ec337-6249-4772-9909-cbc0798958f1 req-47104d7d-8333-4cd4-8af1-71f3cad38795 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:55.552219 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-117ec337-6249-4772-9909-cbc0798958f1 req-47104d7d-8333-4cd4-8af1-71f3cad38795 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:55.566132 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-117ec337-6249-4772-9909-cbc0798958f1 req-47104d7d-8333-4cd4-8af1-71f3cad38795 service nova] Creating event network-vif-deleted:ccdc4c36-ce1d-470e-9208-6ea0c0ff6e38 for instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 on hv-cinder-82549 May 19 15:13:55.569771 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-117ec337-6249-4772-9909-cbc0798958f1 req-47104d7d-8333-4cd4-8af1-71f3cad38795 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030665 May 19 15:13:55.570566 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 424/849] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:13:55.893089 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:13:55.893621 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:13:55.894150 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:13:55.895116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:13:55.895635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:13:55.904415 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:55.904966 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:55.905858 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:55.906368 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:55.930105 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Getting quotas for project 5818d7e3ac5946d9a461cabd216feeee. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:13:55.934034 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Getting quotas for user c8876815343540c284561a0e308cb6e9 and project 5818d7e3ac5946d9a461cabd216feeee. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:13:55.945992 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:13:55.948557 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:13:55.994129 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2624c8cb-7730-4f3d-bf3d-9f83913897ce tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830529 May 19 15:13:55.995029 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 426/850] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:13:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:13:56.006309 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-587c981d-e730-400c-943c-007ba1253fb0 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:56.007029 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-587c981d-e730-400c-943c-007ba1253fb0 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:56.082660 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-587c981d-e730-400c-943c-007ba1253fb0 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:56.090390 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-587c981d-e730-400c-943c-007ba1253fb0 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0" status: 200 len: 1214 microversion: 2.1 time: 0.089332 May 19 15:13:56.101205 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 425/851] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:55 2022] GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:13:57.020901 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1608200354", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "213b532b-8cec-4733-b487-2a170eb06a7a"}], "security_groups": [{"name": "tempest-securitygroup--22015434"}], "key_name": "tempest-keypair-270324715", "user_data": "}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:57.111087 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6863c1bc-9568-458f-b7c8-65460e7b1855 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:57.112326 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-6863c1bc-9568-458f-b7c8-65460e7b1855 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:57.117958 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:57.125320 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6863c1bc-9568-458f-b7c8-65460e7b1855 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:57.126094 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6863c1bc-9568-458f-b7c8-65460e7b1855 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:57.128026 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6863c1bc-9568-458f-b7c8-65460e7b1855 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:57.128533 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6863c1bc-9568-458f-b7c8-65460e7b1855 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:57.130590 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] validate_networks() for [('213b532b-8cec-4733-b487-2a170eb06a7a', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:13:57.229019 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6863c1bc-9568-458f-b7c8-65460e7b1855 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:57.236536 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6863c1bc-9568-458f-b7c8-65460e7b1855 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0" status: 200 len: 1272 microversion: 2.1 time: 0.131874 May 19 15:13:57.237104 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 426/852] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:57 2022] GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:57.538006 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:13:57.538437 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:13:57.538918 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:13:57.539377 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:13:57.539793 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:13:57.542247 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:13:57.552773 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:57.553407 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:57.554234 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:57.554681 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:57.575170 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Getting quotas for project 5b1521fd041a446e851d82487479930b. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:13:57.579182 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Getting quotas for user 0022fc1107834a5cbe30f0146361213b and project 5b1521fd041a446e851d82487479930b. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:13:57.590742 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:13:57.593031 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:13:57.644243 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8bd36271-c0e7-44d2-8b92-dee541d9b2c6 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.628091 May 19 15:13:57.645472 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 427/853] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:13:57 2022] POST /compute/v2.1/servers => generated 400 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:13:57.655517 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-04fd29e5-86d5-49bf-8b3a-9106bf140491 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:57.656134 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-04fd29e5-86d5-49bf-8b3a-9106bf140491 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:57.716248 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-04fd29e5-86d5-49bf-8b3a-9106bf140491 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:57.724796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-04fd29e5-86d5-49bf-8b3a-9106bf140491 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 200 len: 1237 microversion: 2.1 time: 0.073215 May 19 15:13:57.725386 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 427/854] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:57 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:58.254059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9dccd81a-2f0d-41e8-97d8-e41ea3422930 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:58.254671 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9dccd81a-2f0d-41e8-97d8-e41ea3422930 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:58.261897 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9dccd81a-2f0d-41e8-97d8-e41ea3422930 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:58.262346 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9dccd81a-2f0d-41e8-97d8-e41ea3422930 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:58.263372 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9dccd81a-2f0d-41e8-97d8-e41ea3422930 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:58.263834 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9dccd81a-2f0d-41e8-97d8-e41ea3422930 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:58.330739 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-120629f4-e808-471b-baf2-ba5cd3ad24bb req-4fe324d0-e176-4c14-91be-8d5e78cc1ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b11727e-7df7-4c28-be5d-7d93877a98b0", "tag": "5a702a2c-2acc-4ff3-9b78-e29afafe22c9"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:13:58.341014 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-120629f4-e808-471b-baf2-ba5cd3ad24bb req-4fe324d0-e176-4c14-91be-8d5e78cc1ab3 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:58.341463 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-120629f4-e808-471b-baf2-ba5cd3ad24bb req-4fe324d0-e176-4c14-91be-8d5e78cc1ab3 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:58.356555 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-120629f4-e808-471b-baf2-ba5cd3ad24bb req-4fe324d0-e176-4c14-91be-8d5e78cc1ab3 service nova] Creating event network-changed:5a702a2c-2acc-4ff3-9b78-e29afafe22c9 for instance 3b11727e-7df7-4c28-be5d-7d93877a98b0 on hv-cinder-82549 May 19 15:13:58.362651 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-120629f4-e808-471b-baf2-ba5cd3ad24bb req-4fe324d0-e176-4c14-91be-8d5e78cc1ab3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034985 May 19 15:13:58.364429 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 428/855] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:13:58.415705 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9dccd81a-2f0d-41e8-97d8-e41ea3422930 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:58.423108 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9dccd81a-2f0d-41e8-97d8-e41ea3422930 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0" status: 200 len: 1314 microversion: 2.1 time: 0.173031 May 19 15:13:58.423703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 428/856] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:58 2022] GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:13:58.744161 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-21c368c4-b388-4728-9468-f744d2e69d06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:58.744957 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-21c368c4-b388-4728-9468-f744d2e69d06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:58.751800 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-21c368c4-b388-4728-9468-f744d2e69d06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:58.752353 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-21c368c4-b388-4728-9468-f744d2e69d06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:58.753262 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-21c368c4-b388-4728-9468-f744d2e69d06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:58.753838 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-21c368c4-b388-4728-9468-f744d2e69d06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:58.825870 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-21c368c4-b388-4728-9468-f744d2e69d06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:58.834685 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-21c368c4-b388-4728-9468-f744d2e69d06 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 200 len: 1295 microversion: 2.1 time: 0.096689 May 19 15:13:58.835303 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 429/857] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:58 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:59.443610 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-acb2846a-d117-4bbb-8a6b-d77209f4a2df tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:59.446759 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-acb2846a-d117-4bbb-8a6b-d77209f4a2df tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:59.454019 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-acb2846a-d117-4bbb-8a6b-d77209f4a2df tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:59.454494 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-acb2846a-d117-4bbb-8a6b-d77209f4a2df tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:59.455322 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-acb2846a-d117-4bbb-8a6b-d77209f4a2df tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:59.455768 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-acb2846a-d117-4bbb-8a6b-d77209f4a2df tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:59.595509 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-acb2846a-d117-4bbb-8a6b-d77209f4a2df tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:13:59.603684 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-acb2846a-d117-4bbb-8a6b-d77209f4a2df tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0" status: 200 len: 1314 microversion: 2.1 time: 0.166421 May 19 15:13:59.604272 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 429/858] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:59 2022] GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:13:59.852373 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7a694c5e-5ce1-410a-92c4-0e70bd3ad510 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:13:59.852924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7a694c5e-5ce1-410a-92c4-0e70bd3ad510 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:13:59.859427 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a694c5e-5ce1-410a-92c4-0e70bd3ad510 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:59.859887 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a694c5e-5ce1-410a-92c4-0e70bd3ad510 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:13:59.860667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a694c5e-5ce1-410a-92c4-0e70bd3ad510 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:13:59.861107 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7a694c5e-5ce1-410a-92c4-0e70bd3ad510 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:00.000458 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-7a694c5e-5ce1-410a-92c4-0e70bd3ad510 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:00.008874 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7a694c5e-5ce1-410a-92c4-0e70bd3ad510 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 200 len: 1361 microversion: 2.1 time: 0.160900 May 19 15:14:00.009557 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 430/859] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:13:59 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:00.621096 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3cb9fec4-f607-4a88-b0ee-98de37e0d9fc tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:00.621824 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3cb9fec4-f607-4a88-b0ee-98de37e0d9fc tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:00.628384 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3cb9fec4-f607-4a88-b0ee-98de37e0d9fc tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:00.628912 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3cb9fec4-f607-4a88-b0ee-98de37e0d9fc tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:00.629922 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3cb9fec4-f607-4a88-b0ee-98de37e0d9fc tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:00.630362 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3cb9fec4-f607-4a88-b0ee-98de37e0d9fc tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:00.648206 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:00.762051 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3cb9fec4-f607-4a88-b0ee-98de37e0d9fc tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:00.771029 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3cb9fec4-f607-4a88-b0ee-98de37e0d9fc tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0" status: 200 len: 1314 microversion: 2.1 time: 0.153308 May 19 15:14:00.780407 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 430/860] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:00 2022] GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:00.992404 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-10f38ab4-d867-48b7-8694-7c3407d8de9c req-75845999-fde6-4602-9209-29d97fc1f951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15841fc5-24fd-4346-ace6-e95329a39953", "tag": "49ab397e-dedd-4bbf-86b5-75a9240c3e82"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:14:01.001105 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-10f38ab4-d867-48b7-8694-7c3407d8de9c req-75845999-fde6-4602-9209-29d97fc1f951 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:01.001559 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-10f38ab4-d867-48b7-8694-7c3407d8de9c req-75845999-fde6-4602-9209-29d97fc1f951 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:01.026095 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8bf9e9fb-7b0e-4f60-b68f-99d36fb767aa tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:01.026965 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8bf9e9fb-7b0e-4f60-b68f-99d36fb767aa tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:01.031933 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-10f38ab4-d867-48b7-8694-7c3407d8de9c req-75845999-fde6-4602-9209-29d97fc1f951 service nova] Creating event network-changed:49ab397e-dedd-4bbf-86b5-75a9240c3e82 for instance 15841fc5-24fd-4346-ace6-e95329a39953 on hv-cinder-82549 May 19 15:14:01.038833 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-10f38ab4-d867-48b7-8694-7c3407d8de9c req-75845999-fde6-4602-9209-29d97fc1f951 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051078 May 19 15:14:01.039482 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 431/861] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:14:01.041350 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8bf9e9fb-7b0e-4f60-b68f-99d36fb767aa tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:01.041814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8bf9e9fb-7b0e-4f60-b68f-99d36fb767aa tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:01.042604 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8bf9e9fb-7b0e-4f60-b68f-99d36fb767aa tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:01.043050 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8bf9e9fb-7b0e-4f60-b68f-99d36fb767aa tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:01.182555 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8bf9e9fb-7b0e-4f60-b68f-99d36fb767aa tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:01.190234 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8bf9e9fb-7b0e-4f60-b68f-99d36fb767aa tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 200 len: 1361 microversion: 2.1 time: 0.168014 May 19 15:14:01.190813 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 431/862] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:01 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:14:01.789269 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-293edaaa-b3a0-4a06-b6fd-a396c65ad095 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:01.789966 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-293edaaa-b3a0-4a06-b6fd-a396c65ad095 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:01.797142 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-293edaaa-b3a0-4a06-b6fd-a396c65ad095 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:01.797585 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-293edaaa-b3a0-4a06-b6fd-a396c65ad095 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:01.798348 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-293edaaa-b3a0-4a06-b6fd-a396c65ad095 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:01.798781 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-293edaaa-b3a0-4a06-b6fd-a396c65ad095 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:01.803633 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=100 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:01.940612 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-293edaaa-b3a0-4a06-b6fd-a396c65ad095 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:01.948572 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-293edaaa-b3a0-4a06-b6fd-a396c65ad095 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0" status: 200 len: 1314 microversion: 2.1 time: 0.164343 May 19 15:14:01.949141 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 432/863] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:01 2022] GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:02.208112 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6cb9e7b7-a181-4ee0-b7f0-e38e345ae3f9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:02.208748 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6cb9e7b7-a181-4ee0-b7f0-e38e345ae3f9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:02.215157 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6cb9e7b7-a181-4ee0-b7f0-e38e345ae3f9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:02.215656 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6cb9e7b7-a181-4ee0-b7f0-e38e345ae3f9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:02.216448 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6cb9e7b7-a181-4ee0-b7f0-e38e345ae3f9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:02.216897 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6cb9e7b7-a181-4ee0-b7f0-e38e345ae3f9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:02.358598 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-6cb9e7b7-a181-4ee0-b7f0-e38e345ae3f9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:02.368317 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6cb9e7b7-a181-4ee0-b7f0-e38e345ae3f9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 200 len: 1361 microversion: 2.1 time: 0.164658 May 19 15:14:02.369198 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 432/864] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:02 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:02.965776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-217face0-f209-4ddd-9aea-49b51a1af00c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:02.966385 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-217face0-f209-4ddd-9aea-49b51a1af00c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:02.972906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-217face0-f209-4ddd-9aea-49b51a1af00c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:02.973858 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-217face0-f209-4ddd-9aea-49b51a1af00c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:02.974619 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-217face0-f209-4ddd-9aea-49b51a1af00c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:02.975057 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-217face0-f209-4ddd-9aea-49b51a1af00c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:03.101624 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-217face0-f209-4ddd-9aea-49b51a1af00c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:03.108938 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-217face0-f209-4ddd-9aea-49b51a1af00c tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0" status: 200 len: 1314 microversion: 2.1 time: 0.147042 May 19 15:14:03.109531 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 433/865] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:02 2022] GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:03.385410 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fd413e0b-2ef4-4c6f-be5b-2f8a91775ca5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:03.386062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-fd413e0b-2ef4-4c6f-be5b-2f8a91775ca5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:03.392502 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fd413e0b-2ef4-4c6f-be5b-2f8a91775ca5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:03.392961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fd413e0b-2ef4-4c6f-be5b-2f8a91775ca5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:03.393736 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fd413e0b-2ef4-4c6f-be5b-2f8a91775ca5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:03.394178 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-fd413e0b-2ef4-4c6f-be5b-2f8a91775ca5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:03.525408 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-fd413e0b-2ef4-4c6f-be5b-2f8a91775ca5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:03.532748 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fd413e0b-2ef4-4c6f-be5b-2f8a91775ca5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 200 len: 1361 microversion: 2.1 time: 0.151274 May 19 15:14:03.533319 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 433/866] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:03 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:04.125657 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c0a4881b-e315-4c41-8cf2-9649f4a56209 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:04.126276 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c0a4881b-e315-4c41-8cf2-9649f4a56209 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:04.133114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c0a4881b-e315-4c41-8cf2-9649f4a56209 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:04.133565 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c0a4881b-e315-4c41-8cf2-9649f4a56209 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:04.134338 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c0a4881b-e315-4c41-8cf2-9649f4a56209 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:04.134776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c0a4881b-e315-4c41-8cf2-9649f4a56209 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:04.265881 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c0a4881b-e315-4c41-8cf2-9649f4a56209 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:04.274136 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c0a4881b-e315-4c41-8cf2-9649f4a56209 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0" status: 200 len: 1314 microversion: 2.1 time: 0.152471 May 19 15:14:04.274707 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 434/867] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:04 2022] GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:04.423867 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-96c20979-7537-4252-be58-4d5669a814f3 req-954481a3-9572-4748-a8a2-afcb5703eb75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b11727e-7df7-4c28-be5d-7d93877a98b0", "name": "network-vif-plugged", "status": "completed", "tag": "5a702a2c-2acc-4ff3-9b78-e29afafe22c9"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:14:04.432602 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-96c20979-7537-4252-be58-4d5669a814f3 req-954481a3-9572-4748-a8a2-afcb5703eb75 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:04.433175 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-96c20979-7537-4252-be58-4d5669a814f3 req-954481a3-9572-4748-a8a2-afcb5703eb75 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:04.444833 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-96c20979-7537-4252-be58-4d5669a814f3 req-954481a3-9572-4748-a8a2-afcb5703eb75 service nova] Creating event network-vif-plugged:5a702a2c-2acc-4ff3-9b78-e29afafe22c9 for instance 3b11727e-7df7-4c28-be5d-7d93877a98b0 on hv-cinder-82549 May 19 15:14:04.452288 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-96c20979-7537-4252-be58-4d5669a814f3 req-954481a3-9572-4748-a8a2-afcb5703eb75 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031613 May 19 15:14:04.453218 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 434/868] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:14:04.552060 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f4f3624b-9012-4b8b-a4e5-afee5ab10405 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:04.552816 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f4f3624b-9012-4b8b-a4e5-afee5ab10405 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:04.560425 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f4f3624b-9012-4b8b-a4e5-afee5ab10405 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:04.560942 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f4f3624b-9012-4b8b-a4e5-afee5ab10405 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:04.561731 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f4f3624b-9012-4b8b-a4e5-afee5ab10405 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:04.562210 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f4f3624b-9012-4b8b-a4e5-afee5ab10405 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:04.689597 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f4f3624b-9012-4b8b-a4e5-afee5ab10405 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:04.697595 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f4f3624b-9012-4b8b-a4e5-afee5ab10405 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 200 len: 1361 microversion: 2.1 time: 0.151833 May 19 15:14:04.698166 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 435/869] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:04 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:05.290975 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-26733f47-7972-4100-aaf1-d37a7b5ae6e4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:05.291712 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-26733f47-7972-4100-aaf1-d37a7b5ae6e4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:05.297960 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-26733f47-7972-4100-aaf1-d37a7b5ae6e4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:05.298421 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-26733f47-7972-4100-aaf1-d37a7b5ae6e4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:05.299189 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-26733f47-7972-4100-aaf1-d37a7b5ae6e4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:05.299652 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-26733f47-7972-4100-aaf1-d37a7b5ae6e4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:05.432175 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-26733f47-7972-4100-aaf1-d37a7b5ae6e4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:05.439486 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-26733f47-7972-4100-aaf1-d37a7b5ae6e4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0" status: 200 len: 1314 microversion: 2.1 time: 0.152732 May 19 15:14:05.440050 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 435/870] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:05 2022] GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:05.714532 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f068f88e-490e-4f38-9b88-00b80374b8e4 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:05.715072 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f068f88e-490e-4f38-9b88-00b80374b8e4 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:05.724582 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f068f88e-490e-4f38-9b88-00b80374b8e4 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:05.725030 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f068f88e-490e-4f38-9b88-00b80374b8e4 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:05.725800 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f068f88e-490e-4f38-9b88-00b80374b8e4 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:05.726228 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f068f88e-490e-4f38-9b88-00b80374b8e4 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:05.856868 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f068f88e-490e-4f38-9b88-00b80374b8e4 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:05.864260 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f068f88e-490e-4f38-9b88-00b80374b8e4 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 200 len: 1361 microversion: 2.1 time: 0.153679 May 19 15:14:05.864819 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 436/871] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:05 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:06.456331 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7254a9c5-8af2-4537-9242-68c670a911cb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:06.456936 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7254a9c5-8af2-4537-9242-68c670a911cb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:06.463459 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7254a9c5-8af2-4537-9242-68c670a911cb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:06.463907 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7254a9c5-8af2-4537-9242-68c670a911cb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:06.464664 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7254a9c5-8af2-4537-9242-68c670a911cb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:06.465098 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7254a9c5-8af2-4537-9242-68c670a911cb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:06.477382 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-50ae1f55-46e4-4a80-a058-4f451e1f5645 req-9ac029ae-8dfb-43c4-9a8c-1f0c5c275bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15841fc5-24fd-4346-ace6-e95329a39953", "name": "network-vif-plugged", "status": "completed", "tag": "49ab397e-dedd-4bbf-86b5-75a9240c3e82"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:14:06.485439 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-50ae1f55-46e4-4a80-a058-4f451e1f5645 req-9ac029ae-8dfb-43c4-9a8c-1f0c5c275bab service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:06.485895 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-50ae1f55-46e4-4a80-a058-4f451e1f5645 req-9ac029ae-8dfb-43c4-9a8c-1f0c5c275bab service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:06.497746 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-50ae1f55-46e4-4a80-a058-4f451e1f5645 req-9ac029ae-8dfb-43c4-9a8c-1f0c5c275bab service nova] Creating event network-vif-plugged:49ab397e-dedd-4bbf-86b5-75a9240c3e82 for instance 15841fc5-24fd-4346-ace6-e95329a39953 on hv-cinder-82549 May 19 15:14:06.502830 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-50ae1f55-46e4-4a80-a058-4f451e1f5645 req-9ac029ae-8dfb-43c4-9a8c-1f0c5c275bab service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029567 May 19 15:14:06.503524 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 437/872] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:14:06.593516 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7254a9c5-8af2-4537-9242-68c670a911cb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:06.601660 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7254a9c5-8af2-4537-9242-68c670a911cb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0" status: 200 len: 1497 microversion: 2.1 time: 0.149146 May 19 15:14:06.602354 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 436/873] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:06 2022] GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:06.882471 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-ed429353-5082-4365-b18b-13e81449fbfb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:06.883477 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-ed429353-5082-4365-b18b-13e81449fbfb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:06.889629 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ed429353-5082-4365-b18b-13e81449fbfb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:06.890092 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ed429353-5082-4365-b18b-13e81449fbfb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:06.890897 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ed429353-5082-4365-b18b-13e81449fbfb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:06.891396 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-ed429353-5082-4365-b18b-13e81449fbfb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:07.032019 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-ed429353-5082-4365-b18b-13e81449fbfb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:07.039991 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-ed429353-5082-4365-b18b-13e81449fbfb tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 200 len: 1361 microversion: 2.1 time: 0.162293 May 19 15:14:07.040560 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 438/874] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:06 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:07.057777 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-ab924c9d-35da-4ce9-aa9e-c8589cec0968 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:07.058278 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ab924c9d-35da-4ce9-aa9e-c8589cec0968 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:07.064270 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ab924c9d-35da-4ce9-aa9e-c8589cec0968 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:07.064724 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ab924c9d-35da-4ce9-aa9e-c8589cec0968 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:07.065510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ab924c9d-35da-4ce9-aa9e-c8589cec0968 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:07.065928 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-ab924c9d-35da-4ce9-aa9e-c8589cec0968 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:07.090407 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-ab924c9d-35da-4ce9-aa9e-c8589cec0968 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:14:07.162478 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-ab924c9d-35da-4ce9-aa9e-c8589cec0968 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "DELETE /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0" status: 204 len: 0 microversion: 2.1 time: 0.108286 May 19 15:14:07.163176 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 437/875] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:14:07 2022] DELETE /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:14:07.171149 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-373dd517-11a0-419c-a59c-5a4e948c84d4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:07.171792 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-373dd517-11a0-419c-a59c-5a4e948c84d4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:07.177746 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-373dd517-11a0-419c-a59c-5a4e948c84d4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:07.178197 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-373dd517-11a0-419c-a59c-5a4e948c84d4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:07.178948 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-373dd517-11a0-419c-a59c-5a4e948c84d4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:07.179413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-373dd517-11a0-419c-a59c-5a4e948c84d4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:07.306318 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-373dd517-11a0-419c-a59c-5a4e948c84d4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:07.313920 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-373dd517-11a0-419c-a59c-5a4e948c84d4 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0" status: 200 len: 1503 microversion: 2.1 time: 0.146555 May 19 15:14:07.314478 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 439/876] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:07 2022] GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:08.057717 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-04b12a90-6fd8-48b4-ab78-8c3953e9c2f3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:08.058389 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-04b12a90-6fd8-48b4-ab78-8c3953e9c2f3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:08.061046 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=4 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:08.061714 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=12 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:08.067747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-04b12a90-6fd8-48b4-ab78-8c3953e9c2f3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:08.068206 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-04b12a90-6fd8-48b4-ab78-8c3953e9c2f3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:08.068981 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-04b12a90-6fd8-48b4-ab78-8c3953e9c2f3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:08.069425 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-04b12a90-6fd8-48b4-ab78-8c3953e9c2f3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:08.201828 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-04b12a90-6fd8-48b4-ab78-8c3953e9c2f3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:08.209739 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-04b12a90-6fd8-48b4-ab78-8c3953e9c2f3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 200 len: 1361 microversion: 2.1 time: 0.156351 May 19 15:14:08.210297 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 438/877] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:08 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:08.331549 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3832bee8-c3d2-43f9-8e1d-2a69be4c0bdb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:08.332805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-3832bee8-c3d2-43f9-8e1d-2a69be4c0bdb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:08.334829 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=8 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:08.340754 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3832bee8-c3d2-43f9-8e1d-2a69be4c0bdb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:08.341205 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3832bee8-c3d2-43f9-8e1d-2a69be4c0bdb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:08.341972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3832bee8-c3d2-43f9-8e1d-2a69be4c0bdb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:08.342411 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3832bee8-c3d2-43f9-8e1d-2a69be4c0bdb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:08.471776 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-3832bee8-c3d2-43f9-8e1d-2a69be4c0bdb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:08.479091 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-3832bee8-c3d2-43f9-8e1d-2a69be4c0bdb tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0" status: 200 len: 1503 microversion: 2.1 time: 0.151484 May 19 15:14:08.479676 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 440/878] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:08 2022] GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:09.227721 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7e26e52d-c9ac-4e4c-ab96-9023df4b32e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:09.228342 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7e26e52d-c9ac-4e4c-ab96-9023df4b32e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:09.235118 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e26e52d-c9ac-4e4c-ab96-9023df4b32e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:09.235597 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e26e52d-c9ac-4e4c-ab96-9023df4b32e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:09.236364 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e26e52d-c9ac-4e4c-ab96-9023df4b32e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:09.236804 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7e26e52d-c9ac-4e4c-ab96-9023df4b32e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:09.368144 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7e26e52d-c9ac-4e4c-ab96-9023df4b32e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:09.376005 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7e26e52d-c9ac-4e4c-ab96-9023df4b32e3 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 200 len: 1547 microversion: 2.1 time: 0.152987 May 19 15:14:09.376582 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 439/879] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:09 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:09.392298 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a74f1d67-a6a5-4e81-929b-c71fd8f374b5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:09.392821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-a74f1d67-a6a5-4e81-929b-c71fd8f374b5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:09.399657 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a74f1d67-a6a5-4e81-929b-c71fd8f374b5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:09.400116 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a74f1d67-a6a5-4e81-929b-c71fd8f374b5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:09.400930 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a74f1d67-a6a5-4e81-929b-c71fd8f374b5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:09.401371 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a74f1d67-a6a5-4e81-929b-c71fd8f374b5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:09.477300 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-a74f1d67-a6a5-4e81-929b-c71fd8f374b5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089039 May 19 15:14:09.478055 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 441/880] 10.222.0.24 () {58 vars in 1274 bytes} [Thu May 19 15:14:09 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:14:09.498433 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b2673e7e-1320-41cf-9c16-1e0525550163 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:09.499052 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b2673e7e-1320-41cf-9c16-1e0525550163 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:09.506036 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b2673e7e-1320-41cf-9c16-1e0525550163 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:09.506512 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b2673e7e-1320-41cf-9c16-1e0525550163 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:09.507300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b2673e7e-1320-41cf-9c16-1e0525550163 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:09.507746 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b2673e7e-1320-41cf-9c16-1e0525550163 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:09.711864 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b2673e7e-1320-41cf-9c16-1e0525550163 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8876815343540c284561a0e308cb6e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5818d7e3ac5946d9a461cabd216feeee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:09.723962 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b2673e7e-1320-41cf-9c16-1e0525550163 tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0" status: 200 len: 1503 microversion: 2.1 time: 0.230124 May 19 15:14:09.736252 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 440/881] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:09 2022] GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 => generated 1503 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:09.823803 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-8155a6a5-26bb-4da4-a418-4812c382e2ce req-a6d75862-9e44-4a26-ae6d-03f836145cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b11727e-7df7-4c28-be5d-7d93877a98b0", "name": "network-vif-deleted", "tag": "5a702a2c-2acc-4ff3-9b78-e29afafe22c9"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:14:09.839640 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-8155a6a5-26bb-4da4-a418-4812c382e2ce req-a6d75862-9e44-4a26-ae6d-03f836145cdc service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:09.840427 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-8155a6a5-26bb-4da4-a418-4812c382e2ce req-a6d75862-9e44-4a26-ae6d-03f836145cdc service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:09.859301 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-8155a6a5-26bb-4da4-a418-4812c382e2ce req-a6d75862-9e44-4a26-ae6d-03f836145cdc service nova] Creating event network-vif-deleted:5a702a2c-2acc-4ff3-9b78-e29afafe22c9 for instance 3b11727e-7df7-4c28-be5d-7d93877a98b0 on hv-cinder-82549 May 19 15:14:09.866925 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-8155a6a5-26bb-4da4-a418-4812c382e2ce req-a6d75862-9e44-4a26-ae6d-03f836145cdc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048542 May 19 15:14:09.868159 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 442/882] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:14:10.498045 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-ef3645df-7346-427c-8e06-4e90d985213b req-d5fb7303-0092-4c3d-a17e-ee9a98e7a021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15841fc5-24fd-4346-ace6-e95329a39953", "tag": "49ab397e-dedd-4bbf-86b5-75a9240c3e82"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:14:10.506493 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-ef3645df-7346-427c-8e06-4e90d985213b req-d5fb7303-0092-4c3d-a17e-ee9a98e7a021 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:10.506946 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-ef3645df-7346-427c-8e06-4e90d985213b req-d5fb7303-0092-4c3d-a17e-ee9a98e7a021 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:10.517826 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-ef3645df-7346-427c-8e06-4e90d985213b req-d5fb7303-0092-4c3d-a17e-ee9a98e7a021 service nova] Creating event network-changed:49ab397e-dedd-4bbf-86b5-75a9240c3e82 for instance 15841fc5-24fd-4346-ace6-e95329a39953 on hv-cinder-82549 May 19 15:14:10.522814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-ef3645df-7346-427c-8e06-4e90d985213b req-d5fb7303-0092-4c3d-a17e-ee9a98e7a021 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028635 May 19 15:14:10.523507 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 441/883] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:14:10.741085 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b6c7221b-21ad-4cc0-88a4-044d5aec2f6b tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:10.741778 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-b6c7221b-21ad-4cc0-88a4-044d5aec2f6b tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] [instance: 3b11727e-7df7-4c28-be5d-7d93877a98b0] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:10.749370 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b6c7221b-21ad-4cc0-88a4-044d5aec2f6b tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:10.749820 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b6c7221b-21ad-4cc0-88a4-044d5aec2f6b tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:10.750705 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b6c7221b-21ad-4cc0-88a4-044d5aec2f6b tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:10.751145 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-b6c7221b-21ad-4cc0-88a4-044d5aec2f6b tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:10.766484 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-b6c7221b-21ad-4cc0-88a4-044d5aec2f6b tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] HTTP exception thrown: Instance 3b11727e-7df7-4c28-be5d-7d93877a98b0 could not be found. May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b6c7221b-21ad-4cc0-88a4-044d5aec2f6b tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Request method failure captured: May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 HTTP/1.1 May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihl6fe1nEq8jyXVJd6Sgbpa7TGb89mA7BDS7ic2St4XLJFPM-1BNEObu9ZYS328LE75clNp6zMtuCwVeJ-d3UaqCW-gzzb3-WQ8GT92BpjttNHwdlCju5AKd_uf_sLAclQZOHTwQmngi8xtO70kAHaxx4FnaY5erp8DrXklDg1oFwiT4 May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 5818d7e3ac5946d9a461cabd216feeee May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-VolumesActionsTest-2067223529 May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:14:10.768394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:14:10.770310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5818d7e3ac5946d9a461cabd216feeee", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5818d7e3ac5946d9a461cabd216feeee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5818d7e3ac5946d9a461cabd216feeee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5818d7e3ac5946d9a461cabd216feeee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:14:10.770310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-VolumesActionsTest-2067223529 May 19 15:14:10.770310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 5818d7e3ac5946d9a461cabd216feeee May 19 15:14:10.770310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-VolumesActionsTest-2067223529 May 19 15:14:10.770310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-VolumesActionsTest-2067223529-project May 19 15:14:10.770310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:14:10.770310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:14:10.770310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: c8876815343540c284561a0e308cb6e9 May 19 15:14:10.770310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-VolumesActionsTest-2067223529-project May 19 15:14:10.770310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:14:10.770310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 3b11727e-7df7-4c28-be5d-7d93877a98b0 could not be found. May 19 15:14:10.770310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '3b11727e-7df7-4c28-be5d-7d93877a98b0'} May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b11727e-7df7-4c28-be5d-7d93877a98b0 could not be found. May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:14:10.771076 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b11727e-7df7-4c28-be5d-7d93877a98b0 could not be found. May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b11727e-7df7-4c28-be5d-7d93877a98b0 could not be found. May 19 15:14:10.772476 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:14:10.773654 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-b6c7221b-21ad-4cc0-88a4-044d5aec2f6b tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] Returning 404 to user: Instance 3b11727e-7df7-4c28-be5d-7d93877a98b0 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:14:10.773654 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-b6c7221b-21ad-4cc0-88a4-044d5aec2f6b tempest-VolumesActionsTest-2067223529 tempest-VolumesActionsTest-2067223529-project] 10.222.0.24 "GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0" status: 404 len: 111 microversion: 2.1 time: 0.033005 May 19 15:14:10.773654 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 443/884] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:10 2022] GET /compute/v2.1/servers/3b11727e-7df7-4c28-be5d-7d93877a98b0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:14:45.677222 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:45.678133 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:45.682584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1535570551", "imageRef": "72ecf67c-9fe8-42ec-b021-9b14bbc52837", "flavorRef": "452"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:14:45.733641 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] validate_networks() for None {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:14:46.012718 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:14:46.013144 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:14:46.013619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:14:46.014029 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:14:46.014469 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:14:46.023975 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:46.024426 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:46.025230 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:46.025671 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:46.041986 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Getting quotas for project f2bcd4570a054c0eb8131280512ada61. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:14:46.045923 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Getting quotas for user fbd500b2e8e54534b368c3bd664baa24 and project f2bcd4570a054c0eb8131280512ada61. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:14:46.057129 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:14:46.059448 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='72ecf67c-9fe8-42ec-b021-9b14bbc52837',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:14:46.102239 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-10007ef8-5a23-4b10-8d8e-683f93f91c0f tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.426730 May 19 15:14:46.102886 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 442/885] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:14:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:14:46.112873 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-52984e26-52a6-4d8f-b99f-8df1f23fa547 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:46.113601 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-52984e26-52a6-4d8f-b99f-8df1f23fa547 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:46.116338 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=37 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:46.118217 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=56 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:46.404941 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-52984e26-52a6-4d8f-b99f-8df1f23fa547 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd500b2e8e54534b368c3bd664baa24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bcd4570a054c0eb8131280512ada61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:46.413322 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-52984e26-52a6-4d8f-b99f-8df1f23fa547 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313" status: 200 len: 1215 microversion: 2.1 time: 0.304381 May 19 15:14:46.413825 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 444/886] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:46 2022] GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 => generated 1215 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:46.689365 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-52e8bfc7-8c46-4437-860d-ef6124ccabab tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:46.689954 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-52e8bfc7-8c46-4437-860d-ef6124ccabab tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:46.696588 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-52e8bfc7-8c46-4437-860d-ef6124ccabab tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:46.697048 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-52e8bfc7-8c46-4437-860d-ef6124ccabab tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:46.697828 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-52e8bfc7-8c46-4437-860d-ef6124ccabab tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:46.698272 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-52e8bfc7-8c46-4437-860d-ef6124ccabab tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:46.727654 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-52e8bfc7-8c46-4437-860d-ef6124ccabab tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/ips" status: 200 len: 145 microversion: 2.1 time: 0.042658 May 19 15:14:46.728469 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 443/887] 10.222.0.24 () {58 vars in 1247 bytes} [Thu May 19 15:14:46 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:14:47.432067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4f9be33f-1732-4648-adf1-703614059e60 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:47.432850 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4f9be33f-1732-4648-adf1-703614059e60 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:47.440119 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f9be33f-1732-4648-adf1-703614059e60 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:47.440575 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f9be33f-1732-4648-adf1-703614059e60 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:47.441693 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f9be33f-1732-4648-adf1-703614059e60 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:47.442138 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f9be33f-1732-4648-adf1-703614059e60 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:47.507336 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4f9be33f-1732-4648-adf1-703614059e60 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd500b2e8e54534b368c3bd664baa24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bcd4570a054c0eb8131280512ada61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:47.515089 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4f9be33f-1732-4648-adf1-703614059e60 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313" status: 200 len: 1273 microversion: 2.1 time: 0.088588 May 19 15:14:47.515696 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 445/888] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:47 2022] GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:48.041909 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1fafa7d6-1bc1-44db-8853-fb1fb0485adf tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afb1a1f2-e2bc-42fd-bb4e-c98c6e54f761"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:14:48.043834 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1fafa7d6-1bc1-44db-8853-fb1fb0485adf tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:48.051493 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1fafa7d6-1bc1-44db-8853-fb1fb0485adf tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:48.052332 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1fafa7d6-1bc1-44db-8853-fb1fb0485adf tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:48.053219 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1fafa7d6-1bc1-44db-8853-fb1fb0485adf tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:48.053826 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1fafa7d6-1bc1-44db-8853-fb1fb0485adf tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:48.347651 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1fafa7d6-1bc1-44db-8853-fb1fb0485adf tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "POST /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309885 May 19 15:14:48.354293 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 444/889] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 15:14:48 2022] POST /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:14:48.532538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-003d523e-e9ac-4b8f-b8f7-d51a8b8b2bf0 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:48.534325 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-003d523e-e9ac-4b8f-b8f7-d51a8b8b2bf0 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:48.541944 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-003d523e-e9ac-4b8f-b8f7-d51a8b8b2bf0 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:48.542973 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-003d523e-e9ac-4b8f-b8f7-d51a8b8b2bf0 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:48.544362 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-003d523e-e9ac-4b8f-b8f7-d51a8b8b2bf0 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:48.544881 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-003d523e-e9ac-4b8f-b8f7-d51a8b8b2bf0 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:48.781005 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-003d523e-e9ac-4b8f-b8f7-d51a8b8b2bf0 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd500b2e8e54534b368c3bd664baa24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bcd4570a054c0eb8131280512ada61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:48.790154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-003d523e-e9ac-4b8f-b8f7-d51a8b8b2bf0 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313" status: 200 len: 1315 microversion: 2.1 time: 0.261821 May 19 15:14:48.799221 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 446/890] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:48 2022] GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:48.998044 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-8d91a993-58be-4e0b-a3a2-5c74d5cbda43 req-3e9dcb46-9a40-4ba5-b436-11a1c475547c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dcf7197-36e6-47cf-bbd3-dc767165b313", "tag": "bee5f3b8-84b6-4451-9e93-c79ec738ea8e"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:14:49.009813 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-8d91a993-58be-4e0b-a3a2-5c74d5cbda43 req-3e9dcb46-9a40-4ba5-b436-11a1c475547c service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:49.010774 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-8d91a993-58be-4e0b-a3a2-5c74d5cbda43 req-3e9dcb46-9a40-4ba5-b436-11a1c475547c service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:49.025545 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-8d91a993-58be-4e0b-a3a2-5c74d5cbda43 req-3e9dcb46-9a40-4ba5-b436-11a1c475547c service nova] Creating event network-changed:bee5f3b8-84b6-4451-9e93-c79ec738ea8e for instance 6dcf7197-36e6-47cf-bbd3-dc767165b313 on hv-cinder-82549 May 19 15:14:49.044139 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-8d91a993-58be-4e0b-a3a2-5c74d5cbda43 req-3e9dcb46-9a40-4ba5-b436-11a1c475547c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040120 May 19 15:14:49.045131 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 445/891] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:14:49.249202 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-e6bee29b-71a9-4bb0-b194-82d095f7e280 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:49.249637 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e6bee29b-71a9-4bb0-b194-82d095f7e280 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:49.252406 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-f0106f41-43f6-4ed5-83d4-7b8eb1a14a42 req-3f148a97-1bfa-4ced-8df0-d7c497285775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81d166a7-9804-44f0-8e9a-a901a6a29cdc", "tag": "5a44dc9e-4dbb-4932-b730-880e5d1f89e8"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:14:49.256392 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e6bee29b-71a9-4bb0-b194-82d095f7e280 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:49.256848 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e6bee29b-71a9-4bb0-b194-82d095f7e280 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:49.257612 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e6bee29b-71a9-4bb0-b194-82d095f7e280 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:49.258046 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-e6bee29b-71a9-4bb0-b194-82d095f7e280 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:49.262383 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-f0106f41-43f6-4ed5-83d4-7b8eb1a14a42 req-3f148a97-1bfa-4ced-8df0-d7c497285775 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:49.262837 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-f0106f41-43f6-4ed5-83d4-7b8eb1a14a42 req-3f148a97-1bfa-4ced-8df0-d7c497285775 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:49.275664 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-f0106f41-43f6-4ed5-83d4-7b8eb1a14a42 req-3f148a97-1bfa-4ced-8df0-d7c497285775 service nova] Creating event network-changed:5a44dc9e-4dbb-4932-b730-880e5d1f89e8 for instance 81d166a7-9804-44f0-8e9a-a901a6a29cdc on hv-cinder-82549 May 19 15:14:49.281336 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-f0106f41-43f6-4ed5-83d4-7b8eb1a14a42 req-3f148a97-1bfa-4ced-8df0-d7c497285775 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033191 May 19 15:14:49.282541 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 446/892] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:14:49.302493 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-e6bee29b-71a9-4bb0-b194-82d095f7e280 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Going to try to terminate instance {{(pid=117445) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:14:49.402131 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-e6bee29b-71a9-4bb0-b194-82d095f7e280 tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "DELETE /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 204 len: 0 microversion: 2.1 time: 0.156785 May 19 15:14:49.403010 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 447/893] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:14:49 2022] DELETE /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:14:49.413113 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9ea095fc-7157-4815-9555-08bb30ea4c5a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:49.414236 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9ea095fc-7157-4815-9555-08bb30ea4c5a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:49.420817 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9ea095fc-7157-4815-9555-08bb30ea4c5a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:49.421348 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9ea095fc-7157-4815-9555-08bb30ea4c5a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:49.422339 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9ea095fc-7157-4815-9555-08bb30ea4c5a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:49.422998 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9ea095fc-7157-4815-9555-08bb30ea4c5a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:49.559871 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9ea095fc-7157-4815-9555-08bb30ea4c5a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:49.569082 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9ea095fc-7157-4815-9555-08bb30ea4c5a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1569 microversion: 2.1 time: 0.160624 May 19 15:14:49.569659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 447/894] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:49 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:49.808152 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-5aa6f16d-c63f-4d32-8a7b-78f2259d7da3 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:49.808865 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-5aa6f16d-c63f-4d32-8a7b-78f2259d7da3 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:49.815257 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5aa6f16d-c63f-4d32-8a7b-78f2259d7da3 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:49.815715 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5aa6f16d-c63f-4d32-8a7b-78f2259d7da3 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:49.816504 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5aa6f16d-c63f-4d32-8a7b-78f2259d7da3 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:49.816927 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5aa6f16d-c63f-4d32-8a7b-78f2259d7da3 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:49.952674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5aa6f16d-c63f-4d32-8a7b-78f2259d7da3 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd500b2e8e54534b368c3bd664baa24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bcd4570a054c0eb8131280512ada61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:49.960456 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-5aa6f16d-c63f-4d32-8a7b-78f2259d7da3 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313" status: 200 len: 1315 microversion: 2.1 time: 0.156558 May 19 15:14:49.961043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 448/895] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:49 2022] GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:50.587987 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-147c6b67-5d65-4c36-8a18-bf0c27407cdc tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:50.588641 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-147c6b67-5d65-4c36-8a18-bf0c27407cdc tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:50.595042 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-147c6b67-5d65-4c36-8a18-bf0c27407cdc tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:50.595536 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-147c6b67-5d65-4c36-8a18-bf0c27407cdc tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:50.596311 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-147c6b67-5d65-4c36-8a18-bf0c27407cdc tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:50.597057 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-147c6b67-5d65-4c36-8a18-bf0c27407cdc tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:50.732261 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-147c6b67-5d65-4c36-8a18-bf0c27407cdc tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:50.739752 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-147c6b67-5d65-4c36-8a18-bf0c27407cdc tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1569 microversion: 2.1 time: 0.156279 May 19 15:14:50.740949 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 448/896] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:50 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:50.977538 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-672b5063-4e1d-4d41-a555-cb71512543ff tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:50.978144 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-672b5063-4e1d-4d41-a555-cb71512543ff tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:50.984654 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-672b5063-4e1d-4d41-a555-cb71512543ff tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:50.985102 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-672b5063-4e1d-4d41-a555-cb71512543ff tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:50.985860 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-672b5063-4e1d-4d41-a555-cb71512543ff tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:50.986292 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-672b5063-4e1d-4d41-a555-cb71512543ff tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:51.114469 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-672b5063-4e1d-4d41-a555-cb71512543ff tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd500b2e8e54534b368c3bd664baa24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bcd4570a054c0eb8131280512ada61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:51.122201 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-672b5063-4e1d-4d41-a555-cb71512543ff tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313" status: 200 len: 1315 microversion: 2.1 time: 0.148989 May 19 15:14:51.122763 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 449/897] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:50 2022] GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:51.758197 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b845d311-3731-46cc-82b6-c707b364606a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:51.758816 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b845d311-3731-46cc-82b6-c707b364606a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:51.765191 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b845d311-3731-46cc-82b6-c707b364606a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:51.765652 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b845d311-3731-46cc-82b6-c707b364606a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:51.766420 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b845d311-3731-46cc-82b6-c707b364606a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:51.766864 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b845d311-3731-46cc-82b6-c707b364606a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:51.919525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b845d311-3731-46cc-82b6-c707b364606a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:51.927309 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b845d311-3731-46cc-82b6-c707b364606a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1569 microversion: 2.1 time: 0.173496 May 19 15:14:51.928496 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 449/898] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:51 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:52.140381 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-5d716d04-ec5b-437f-ac4b-a459a4f8aa14 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:52.141759 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-5d716d04-ec5b-437f-ac4b-a459a4f8aa14 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:52.149240 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5d716d04-ec5b-437f-ac4b-a459a4f8aa14 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:52.149901 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5d716d04-ec5b-437f-ac4b-a459a4f8aa14 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:52.150676 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5d716d04-ec5b-437f-ac4b-a459a4f8aa14 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:52.151118 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5d716d04-ec5b-437f-ac4b-a459a4f8aa14 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:52.342688 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5d716d04-ec5b-437f-ac4b-a459a4f8aa14 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd500b2e8e54534b368c3bd664baa24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bcd4570a054c0eb8131280512ada61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:52.350821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-5d716d04-ec5b-437f-ac4b-a459a4f8aa14 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313" status: 200 len: 1315 microversion: 2.1 time: 0.215008 May 19 15:14:52.351336 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 450/899] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:52 2022] GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:52.444779 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-447b6999-b45f-4bcf-a934-e0e664693c32 req-86aa2cca-c2c9-4de8-b704-fa73f46d89c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d166a7-9804-44f0-8e9a-a901a6a29cdc", "name": "network-vif-deleted", "tag": "5a44dc9e-4dbb-4932-b730-880e5d1f89e8"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:14:52.454234 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-447b6999-b45f-4bcf-a934-e0e664693c32 req-86aa2cca-c2c9-4de8-b704-fa73f46d89c7 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:52.454682 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-447b6999-b45f-4bcf-a934-e0e664693c32 req-86aa2cca-c2c9-4de8-b704-fa73f46d89c7 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:52.467033 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-447b6999-b45f-4bcf-a934-e0e664693c32 req-86aa2cca-c2c9-4de8-b704-fa73f46d89c7 service nova] Creating event network-vif-deleted:5a44dc9e-4dbb-4932-b730-880e5d1f89e8 for instance 81d166a7-9804-44f0-8e9a-a901a6a29cdc on hv-cinder-82549 May 19 15:14:52.472668 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-447b6999-b45f-4bcf-a934-e0e664693c32 req-86aa2cca-c2c9-4de8-b704-fa73f46d89c7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031593 May 19 15:14:52.473258 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 450/900] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:14:52.944902 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-1e0e4e79-9d14-4961-9421-257ca488552c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:52.945820 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-1e0e4e79-9d14-4961-9421-257ca488552c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:52.952036 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1e0e4e79-9d14-4961-9421-257ca488552c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:52.952488 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1e0e4e79-9d14-4961-9421-257ca488552c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:52.953261 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1e0e4e79-9d14-4961-9421-257ca488552c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:52.953706 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1e0e4e79-9d14-4961-9421-257ca488552c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:52.989223 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1e0e4e79-9d14-4961-9421-257ca488552c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:52.989675 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-1e0e4e79-9d14-4961-9421-257ca488552c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:52.990143 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-1e0e4e79-9d14-4961-9421-257ca488552c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lazy-loading 'fault' on Instance uuid 81d166a7-9804-44f0-8e9a-a901a6a29cdc {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:14:53.035401 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-1e0e4e79-9d14-4961-9421-257ca488552c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e29cb55f7d4acabfc451e996b07791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9ba7310e7e4d558dba77f08668b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:53.043684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-1e0e4e79-9d14-4961-9421-257ca488552c tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 200 len: 1224 microversion: 2.1 time: 0.103130 May 19 15:14:53.044263 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 451/901] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:52 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:53.369059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-647b9fc1-c52a-4ea3-abc1-ece3decc8ef8 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:53.370064 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-647b9fc1-c52a-4ea3-abc1-ece3decc8ef8 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:53.376345 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-647b9fc1-c52a-4ea3-abc1-ece3decc8ef8 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:53.376807 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-647b9fc1-c52a-4ea3-abc1-ece3decc8ef8 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:53.377581 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-647b9fc1-c52a-4ea3-abc1-ece3decc8ef8 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:53.378025 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-647b9fc1-c52a-4ea3-abc1-ece3decc8ef8 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:53.518545 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-647b9fc1-c52a-4ea3-abc1-ece3decc8ef8 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd500b2e8e54534b368c3bd664baa24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bcd4570a054c0eb8131280512ada61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:53.525959 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-647b9fc1-c52a-4ea3-abc1-ece3decc8ef8 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313" status: 200 len: 1315 microversion: 2.1 time: 0.162060 May 19 15:14:53.526530 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 451/902] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:53 2022] GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:54.060340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3da2600d-7216-4913-b60c-10e756cada1a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:54.060872 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-3da2600d-7216-4913-b60c-10e756cada1a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] [instance: 81d166a7-9804-44f0-8e9a-a901a6a29cdc] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:54.067259 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3da2600d-7216-4913-b60c-10e756cada1a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:54.067707 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3da2600d-7216-4913-b60c-10e756cada1a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:54.068466 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3da2600d-7216-4913-b60c-10e756cada1a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:54.068898 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3da2600d-7216-4913-b60c-10e756cada1a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:54.081902 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-3da2600d-7216-4913-b60c-10e756cada1a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] HTTP exception thrown: Instance 81d166a7-9804-44f0-8e9a-a901a6a29cdc could not be found. May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3da2600d-7216-4913-b60c-10e756cada1a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Request method failure captured: May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc HTTP/1.1 May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihl3S5tS5SgAYRQ-Hw4LeWRyE9Ly-hO37sCILx8Id8Pkwl2zfKRUQJA89qwthzMExVt4peprcDVw076M8m0TSlzNK4AUve-cnyVgYeIky8Nu3qzvvmOr8WP44Y2GWQpLSYHolclmGg5Qu9wuaTb1KS-qmMsamCRb_vcOTj-gqO9ewsVM May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: ee9ba7310e7e4d558dba77f08668b77b May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-TestShelveInstance-1586969170 May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:14:54.083527 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:14:54.085670 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ee9ba7310e7e4d558dba77f08668b77b", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ee9ba7310e7e4d558dba77f08668b77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ee9ba7310e7e4d558dba77f08668b77b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ee9ba7310e7e4d558dba77f08668b77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:14:54.085670 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-TestShelveInstance-1586969170 May 19 15:14:54.085670 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: ee9ba7310e7e4d558dba77f08668b77b May 19 15:14:54.085670 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-TestShelveInstance-1586969170 May 19 15:14:54.085670 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-TestShelveInstance-1586969170-project May 19 15:14:54.085670 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:14:54.085670 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:14:54.085670 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 48e29cb55f7d4acabfc451e996b07791 May 19 15:14:54.085670 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-TestShelveInstance-1586969170-project May 19 15:14:54.085670 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:14:54.085670 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 81d166a7-9804-44f0-8e9a-a901a6a29cdc could not be found. May 19 15:14:54.085670 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '81d166a7-9804-44f0-8e9a-a901a6a29cdc'} May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81d166a7-9804-44f0-8e9a-a901a6a29cdc could not be found. May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:14:54.086796 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81d166a7-9804-44f0-8e9a-a901a6a29cdc could not be found. May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81d166a7-9804-44f0-8e9a-a901a6a29cdc could not be found. May 19 15:14:54.088379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:14:54.089891 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3da2600d-7216-4913-b60c-10e756cada1a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Returning 404 to user: Instance 81d166a7-9804-44f0-8e9a-a901a6a29cdc could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:14:54.089891 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-3da2600d-7216-4913-b60c-10e756cada1a tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc" status: 404 len: 111 microversion: 2.1 time: 0.028982 May 19 15:14:54.089891 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 452/903] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:54 2022] GET /compute/v2.1/servers/81d166a7-9804-44f0-8e9a-a901a6a29cdc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 15:14:54.244177 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b1c612bf-cee8-4011-905c-6cebf745eaef tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] Calling method '.version_select at 0x7f35d12794c0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:54.264118 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b1c612bf-cee8-4011-905c-6cebf745eaef tempest-TestShelveInstance-1586969170 tempest-TestShelveInstance-1586969170-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-889694620" status: 202 len: 0 microversion: 2.1 time: 0.023453 May 19 15:14:54.264714 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 452/904] 10.222.0.24 () {58 vars in 1250 bytes} [Thu May 19 15:14:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-889694620 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:14:54.542467 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-cac8618f-ee36-4ddd-8ee4-24bcaa6df5de tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:54.543391 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-cac8618f-ee36-4ddd-8ee4-24bcaa6df5de tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:54.549433 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-3a433d45-106d-4769-be6a-7dfef90b855c req-91818ec0-9775-4de8-a0a3-839d95f17ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcf7197-36e6-47cf-bbd3-dc767165b313", "name": "network-vif-plugged", "status": "completed", "tag": "bee5f3b8-84b6-4451-9e93-c79ec738ea8e"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:14:54.566964 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-3a433d45-106d-4769-be6a-7dfef90b855c req-91818ec0-9775-4de8-a0a3-839d95f17ca4 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:54.567370 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-3a433d45-106d-4769-be6a-7dfef90b855c req-91818ec0-9775-4de8-a0a3-839d95f17ca4 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:54.572635 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cac8618f-ee36-4ddd-8ee4-24bcaa6df5de tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:54.573379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cac8618f-ee36-4ddd-8ee4-24bcaa6df5de tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:54.574193 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cac8618f-ee36-4ddd-8ee4-24bcaa6df5de tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:54.574803 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-cac8618f-ee36-4ddd-8ee4-24bcaa6df5de tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:54.597894 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-3a433d45-106d-4769-be6a-7dfef90b855c req-91818ec0-9775-4de8-a0a3-839d95f17ca4 service nova] Creating event network-vif-plugged:bee5f3b8-84b6-4451-9e93-c79ec738ea8e for instance 6dcf7197-36e6-47cf-bbd3-dc767165b313 on hv-cinder-82549 May 19 15:14:54.602928 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-3a433d45-106d-4769-be6a-7dfef90b855c req-91818ec0-9775-4de8-a0a3-839d95f17ca4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057319 May 19 15:14:54.604863 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 453/905] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:14:54.723902 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-cac8618f-ee36-4ddd-8ee4-24bcaa6df5de tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd500b2e8e54534b368c3bd664baa24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bcd4570a054c0eb8131280512ada61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:54.731434 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-cac8618f-ee36-4ddd-8ee4-24bcaa6df5de tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313" status: 200 len: 1315 microversion: 2.1 time: 0.193004 May 19 15:14:54.732284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 453/906] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:54 2022] GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:55.750061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-62153f17-3c06-481d-aa3b-2cd828294e45 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:55.750768 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-62153f17-3c06-481d-aa3b-2cd828294e45 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:55.757131 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-62153f17-3c06-481d-aa3b-2cd828294e45 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:55.757591 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-62153f17-3c06-481d-aa3b-2cd828294e45 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:55.758374 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-62153f17-3c06-481d-aa3b-2cd828294e45 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:55.758816 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-62153f17-3c06-481d-aa3b-2cd828294e45 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:55.905815 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4d737ce6-5d32-49bf-ad76-a4a46b6413a8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:55.907501 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4d737ce6-5d32-49bf-ad76-a4a46b6413a8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:55.908334 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-62153f17-3c06-481d-aa3b-2cd828294e45 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd500b2e8e54534b368c3bd664baa24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bcd4570a054c0eb8131280512ada61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:55.914572 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4d737ce6-5d32-49bf-ad76-a4a46b6413a8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:55.915029 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4d737ce6-5d32-49bf-ad76-a4a46b6413a8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:55.915818 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4d737ce6-5d32-49bf-ad76-a4a46b6413a8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:55.915949 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-62153f17-3c06-481d-aa3b-2cd828294e45 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313" status: 200 len: 1315 microversion: 2.1 time: 0.170807 May 19 15:14:55.916487 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 454/907] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:55 2022] GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:55.916615 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4d737ce6-5d32-49bf-ad76-a4a46b6413a8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:55.949989 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4d737ce6-5d32-49bf-ad76-a4a46b6413a8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048085 May 19 15:14:55.950555 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 454/908] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:14:55 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:14:55.960959 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-053283ba-d509-44aa-9673-e1e7ee9ad9fc tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:55.961537 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-053283ba-d509-44aa-9673-e1e7ee9ad9fc tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:55.968017 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-053283ba-d509-44aa-9673-e1e7ee9ad9fc tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:55.968553 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-053283ba-d509-44aa-9673-e1e7ee9ad9fc tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:55.969401 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-053283ba-d509-44aa-9673-e1e7ee9ad9fc tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:55.969913 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-053283ba-d509-44aa-9673-e1e7ee9ad9fc tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:55.999930 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-053283ba-d509-44aa-9673-e1e7ee9ad9fc tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments/afb1a1f2-e2bc-42fd-bb4e-c98c6e54f761" status: 200 len: 194 microversion: 2.1 time: 0.043375 May 19 15:14:56.000664 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 455/909] 10.222.0.24 () {58 vars in 1412 bytes} [Thu May 19 15:14:55 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments/afb1a1f2-e2bc-42fd-bb4e-c98c6e54f761 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:14:56.933146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a4780e3d-b977-43bc-bcda-1d694b89b3b4 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:56.933929 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-a4780e3d-b977-43bc-bcda-1d694b89b3b4 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:56.936040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=2 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:56.945014 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a4780e3d-b977-43bc-bcda-1d694b89b3b4 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:56.945475 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a4780e3d-b977-43bc-bcda-1d694b89b3b4 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:56.946933 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a4780e3d-b977-43bc-bcda-1d694b89b3b4 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:56.946933 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a4780e3d-b977-43bc-bcda-1d694b89b3b4 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:57.106743 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-a4780e3d-b977-43bc-bcda-1d694b89b3b4 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd500b2e8e54534b368c3bd664baa24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bcd4570a054c0eb8131280512ada61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:57.114235 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-a4780e3d-b977-43bc-bcda-1d694b89b3b4 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313" status: 200 len: 1465 microversion: 2.1 time: 0.184977 May 19 15:14:57.115643 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 455/910] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:56 2022] GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 => generated 1465 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:57.156899 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-796c0f6f-1e51-4a86-9072-c8a21e575762 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:57.157455 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-796c0f6f-1e51-4a86-9072-c8a21e575762 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:57.159320 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:57.160198 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:14:57.166985 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-796c0f6f-1e51-4a86-9072-c8a21e575762 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:57.167476 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-796c0f6f-1e51-4a86-9072-c8a21e575762 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:57.168253 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-796c0f6f-1e51-4a86-9072-c8a21e575762 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:57.168692 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-796c0f6f-1e51-4a86-9072-c8a21e575762 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:57.194826 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-796c0f6f-1e51-4a86-9072-c8a21e575762 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:14:57.272677 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-796c0f6f-1e51-4a86-9072-c8a21e575762 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "DELETE /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313" status: 204 len: 0 microversion: 2.1 time: 0.119352 May 19 15:14:57.274798 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 456/911] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:14:57 2022] DELETE /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:14:57.285427 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c64b4a7f-3273-4b0a-9d1e-b157e843ae0a tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:57.286087 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c64b4a7f-3273-4b0a-9d1e-b157e843ae0a tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:57.292199 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c64b4a7f-3273-4b0a-9d1e-b157e843ae0a tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:57.292646 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c64b4a7f-3273-4b0a-9d1e-b157e843ae0a tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:57.293402 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c64b4a7f-3273-4b0a-9d1e-b157e843ae0a tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:57.293849 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c64b4a7f-3273-4b0a-9d1e-b157e843ae0a tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:57.459773 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0f780ea9-7a22-4cf8-a3e3-73ccd285796c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42035427-525b-40c9-9cff-23916db12f5a"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:14:57.462112 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0f780ea9-7a22-4cf8-a3e3-73ccd285796c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:57.469434 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0f780ea9-7a22-4cf8-a3e3-73ccd285796c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:57.470190 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0f780ea9-7a22-4cf8-a3e3-73ccd285796c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:57.471228 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0f780ea9-7a22-4cf8-a3e3-73ccd285796c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:57.472282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0f780ea9-7a22-4cf8-a3e3-73ccd285796c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:57.495374 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c64b4a7f-3273-4b0a-9d1e-b157e843ae0a tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd500b2e8e54534b368c3bd664baa24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bcd4570a054c0eb8131280512ada61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:57.503364 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c64b4a7f-3273-4b0a-9d1e-b157e843ae0a tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313" status: 200 len: 1471 microversion: 2.1 time: 0.224158 May 19 15:14:57.504475 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 456/912] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:57 2022] GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 => generated 1471 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:58.456545 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0f780ea9-7a22-4cf8-a3e3-73ccd285796c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "POST /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.001850 May 19 15:14:58.459504 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 457/913] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 15:14:57 2022] POST /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments => generated 194 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:14:58.521768 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c233119c-c5e6-47e0-994b-6e9f9f035227 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:58.523067 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c233119c-c5e6-47e0-994b-6e9f9f035227 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:58.530222 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c233119c-c5e6-47e0-994b-6e9f9f035227 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:58.530727 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c233119c-c5e6-47e0-994b-6e9f9f035227 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:58.532003 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c233119c-c5e6-47e0-994b-6e9f9f035227 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:58.532456 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c233119c-c5e6-47e0-994b-6e9f9f035227 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:58.825498 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c233119c-c5e6-47e0-994b-6e9f9f035227 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd500b2e8e54534b368c3bd664baa24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bcd4570a054c0eb8131280512ada61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:58.833261 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c233119c-c5e6-47e0-994b-6e9f9f035227 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313" status: 200 len: 1471 microversion: 2.1 time: 0.315864 May 19 15:14:58.834237 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 457/914] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:58 2022] GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:14:59.452631 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-4bb678f9-4429-402b-90c6-e717d4eb20f4 req-9b0c0d99-5f90-4574-8117-78ce3f033ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcf7197-36e6-47cf-bbd3-dc767165b313", "name": "network-vif-deleted", "tag": "bee5f3b8-84b6-4451-9e93-c79ec738ea8e"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:14:59.479642 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-4bb678f9-4429-402b-90c6-e717d4eb20f4 req-9b0c0d99-5f90-4574-8117-78ce3f033ab0 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:59.480866 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-4bb678f9-4429-402b-90c6-e717d4eb20f4 req-9b0c0d99-5f90-4574-8117-78ce3f033ab0 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:59.500914 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-4bb678f9-4429-402b-90c6-e717d4eb20f4 req-9b0c0d99-5f90-4574-8117-78ce3f033ab0 service nova] Creating event network-vif-deleted:bee5f3b8-84b6-4451-9e93-c79ec738ea8e for instance 6dcf7197-36e6-47cf-bbd3-dc767165b313 on hv-cinder-82549 May 19 15:14:59.507926 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-4bb678f9-4429-402b-90c6-e717d4eb20f4 req-9b0c0d99-5f90-4574-8117-78ce3f033ab0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063790 May 19 15:14:59.508705 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 458/915] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:14:59.850498 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-70c1f8b7-b753-46d1-9809-1142f6455444 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:14:59.851110 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-70c1f8b7-b753-46d1-9809-1142f6455444 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:14:59.858353 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-70c1f8b7-b753-46d1-9809-1142f6455444 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:59.859108 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-70c1f8b7-b753-46d1-9809-1142f6455444 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:59.859895 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-70c1f8b7-b753-46d1-9809-1142f6455444 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:59.860498 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-70c1f8b7-b753-46d1-9809-1142f6455444 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:59.893473 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-70c1f8b7-b753-46d1-9809-1142f6455444 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:14:59.894181 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-70c1f8b7-b753-46d1-9809-1142f6455444 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:14:59.894817 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-70c1f8b7-b753-46d1-9809-1142f6455444 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lazy-loading 'fault' on Instance uuid 6dcf7197-36e6-47cf-bbd3-dc767165b313 {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:14:59.974505 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-70c1f8b7-b753-46d1-9809-1142f6455444 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbd500b2e8e54534b368c3bd664baa24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2bcd4570a054c0eb8131280512ada61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:14:59.981611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-70c1f8b7-b753-46d1-9809-1142f6455444 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313" status: 200 len: 1305 microversion: 2.1 time: 0.135103 May 19 15:14:59.982397 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 458/916] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:14:59 2022] GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 => generated 1305 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:15:01.000342 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-16c5cf9a-f1b9-418c-aaa8-e548e9136782 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:01.001043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-16c5cf9a-f1b9-418c-aaa8-e548e9136782 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] [instance: 6dcf7197-36e6-47cf-bbd3-dc767165b313] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:01.008043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-16c5cf9a-f1b9-418c-aaa8-e548e9136782 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:01.008507 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-16c5cf9a-f1b9-418c-aaa8-e548e9136782 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:01.009283 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-16c5cf9a-f1b9-418c-aaa8-e548e9136782 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:01.009724 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-16c5cf9a-f1b9-418c-aaa8-e548e9136782 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:01.023586 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-16c5cf9a-f1b9-418c-aaa8-e548e9136782 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] HTTP exception thrown: Instance 6dcf7197-36e6-47cf-bbd3-dc767165b313 could not be found. May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-16c5cf9a-f1b9-418c-aaa8-e548e9136782 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Request method failure captured: May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 HTTP/1.1 May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihl7keUgD0iSubel_fJ2fERa4aoLbpDwS19pSzSuK7GPe2En9-ulG9ZO6oDvVsJ1hxFpUIyX2-IOwbKaCImYSW8woEmMu0exUfuR8Pvza8t9KFZ0UgtOtwktY6KmXu1R-pkEuR9b5DtTShnX2shxunJHkP0n6e8wEGlHoMwRAoiGKudY May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: f2bcd4570a054c0eb8131280512ada61 May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-VolumesNegativeTest-1633496481 May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:15:01.025160 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:15:01.026726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_f2bcd4570a054c0eb8131280512ada61", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f2bcd4570a054c0eb8131280512ada61"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f2bcd4570a054c0eb8131280512ada61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/f2bcd4570a054c0eb8131280512ada61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:15:01.026726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-VolumesNegativeTest-1633496481 May 19 15:15:01.026726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: f2bcd4570a054c0eb8131280512ada61 May 19 15:15:01.026726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-VolumesNegativeTest-1633496481 May 19 15:15:01.026726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-VolumesNegativeTest-1633496481-project May 19 15:15:01.026726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:15:01.026726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:15:01.026726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: fbd500b2e8e54534b368c3bd664baa24 May 19 15:15:01.026726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-VolumesNegativeTest-1633496481-project May 19 15:15:01.026726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:15:01.026726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance 6dcf7197-36e6-47cf-bbd3-dc767165b313 could not be found. May 19 15:15:01.026726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': '6dcf7197-36e6-47cf-bbd3-dc767165b313'} May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcf7197-36e6-47cf-bbd3-dc767165b313 could not be found. May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:15:01.027632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcf7197-36e6-47cf-bbd3-dc767165b313 could not be found. May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcf7197-36e6-47cf-bbd3-dc767165b313 could not be found. May 19 15:15:01.029125 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:01.030727 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-16c5cf9a-f1b9-418c-aaa8-e548e9136782 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] Returning 404 to user: Instance 6dcf7197-36e6-47cf-bbd3-dc767165b313 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:15:01.030727 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-16c5cf9a-f1b9-418c-aaa8-e548e9136782 tempest-VolumesNegativeTest-1633496481 tempest-VolumesNegativeTest-1633496481-project] 10.222.0.24 "GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313" status: 404 len: 111 microversion: 2.1 time: 0.030489 May 19 15:15:01.030727 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 459/917] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:15:00 2022] GET /compute/v2.1/servers/6dcf7197-36e6-47cf-bbd3-dc767165b313 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:15:06.025839 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-fb615eb7-ccbf-483a-9b65-48c6a11688b4 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:06.026783 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-fb615eb7-ccbf-483a-9b65-48c6a11688b4 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:06.033974 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fb615eb7-ccbf-483a-9b65-48c6a11688b4 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:06.034724 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fb615eb7-ccbf-483a-9b65-48c6a11688b4 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:06.035816 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fb615eb7-ccbf-483a-9b65-48c6a11688b4 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:06.036267 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fb615eb7-ccbf-483a-9b65-48c6a11688b4 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:06.063309 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:06.069484 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-fb615eb7-ccbf-483a-9b65-48c6a11688b4 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047663 May 19 15:15:06.070057 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 459/918] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:15:06 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:15:06.207430 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-f8a70405-7572-49bd-8e48-d10310b2241d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:06.207958 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-f8a70405-7572-49bd-8e48-d10310b2241d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:06.214599 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f8a70405-7572-49bd-8e48-d10310b2241d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:06.215002 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f8a70405-7572-49bd-8e48-d10310b2241d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:06.215821 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f8a70405-7572-49bd-8e48-d10310b2241d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:06.216266 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-f8a70405-7572-49bd-8e48-d10310b2241d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:06.220093 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:06.247467 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-f8a70405-7572-49bd-8e48-d10310b2241d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments/afb1a1f2-e2bc-42fd-bb4e-c98c6e54f761" status: 200 len: 194 microversion: 2.1 time: 0.043942 May 19 15:15:06.248062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 460/919] 10.222.0.24 () {58 vars in 1412 bytes} [Thu May 19 15:15:06 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments/afb1a1f2-e2bc-42fd-bb4e-c98c6e54f761 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:15:06.258647 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d9d96967-f3cd-4a7b-86e1-f80a6c84aeca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:06.259151 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-d9d96967-f3cd-4a7b-86e1-f80a6c84aeca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:06.266135 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d9d96967-f3cd-4a7b-86e1-f80a6c84aeca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:06.266587 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d9d96967-f3cd-4a7b-86e1-f80a6c84aeca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:06.267394 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d9d96967-f3cd-4a7b-86e1-f80a6c84aeca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:06.267841 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d9d96967-f3cd-4a7b-86e1-f80a6c84aeca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:06.348915 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-d9d96967-f3cd-4a7b-86e1-f80a6c84aeca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lazy-loading 'services' on Instance uuid 15841fc5-24fd-4346-ace6-e95329a39953 {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:15:06.419572 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-d9d96967-f3cd-4a7b-86e1-f80a6c84aeca tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "DELETE /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments/afb1a1f2-e2bc-42fd-bb4e-c98c6e54f761" status: 202 len: 0 microversion: 2.1 time: 0.165696 May 19 15:15:06.420151 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 460/920] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 15:15:06 2022] DELETE /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments/afb1a1f2-e2bc-42fd-bb4e-c98c6e54f761 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:15:07.533035 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-01449ae7-6b1a-4bb2-a4c9-e18410363106 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:07.533536 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-01449ae7-6b1a-4bb2-a4c9-e18410363106 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:07.541168 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01449ae7-6b1a-4bb2-a4c9-e18410363106 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:07.541633 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01449ae7-6b1a-4bb2-a4c9-e18410363106 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:07.542414 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01449ae7-6b1a-4bb2-a4c9-e18410363106 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:07.542862 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01449ae7-6b1a-4bb2-a4c9-e18410363106 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:07.574017 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-01449ae7-6b1a-4bb2-a4c9-e18410363106 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments/42035427-525b-40c9-9cff-23916db12f5a" status: 200 len: 194 microversion: 2.1 time: 0.044888 May 19 15:15:07.574590 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 461/921] 10.222.0.24 () {58 vars in 1412 bytes} [Thu May 19 15:15:07 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments/42035427-525b-40c9-9cff-23916db12f5a => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:15:07.586288 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-044b174d-ec80-47ed-9699-ee1cd30f2b47 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:07.586877 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-044b174d-ec80-47ed-9699-ee1cd30f2b47 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:07.593112 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-044b174d-ec80-47ed-9699-ee1cd30f2b47 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:07.593569 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-044b174d-ec80-47ed-9699-ee1cd30f2b47 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:07.594337 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-044b174d-ec80-47ed-9699-ee1cd30f2b47 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:07.594772 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-044b174d-ec80-47ed-9699-ee1cd30f2b47 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:07.674712 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-044b174d-ec80-47ed-9699-ee1cd30f2b47 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lazy-loading 'services' on Instance uuid 15841fc5-24fd-4346-ace6-e95329a39953 {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:15:07.744340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-044b174d-ec80-47ed-9699-ee1cd30f2b47 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "DELETE /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments/42035427-525b-40c9-9cff-23916db12f5a" status: 202 len: 0 microversion: 2.1 time: 0.163326 May 19 15:15:07.744871 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 461/922] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 15:15:07 2022] DELETE /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments/42035427-525b-40c9-9cff-23916db12f5a => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:15:08.902817 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-768d0dfb-d92f-43cb-a2c4-b68f09cdc76a tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:08.903776 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-768d0dfb-d92f-43cb-a2c4-b68f09cdc76a tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:08.910106 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-768d0dfb-d92f-43cb-a2c4-b68f09cdc76a tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:08.910562 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-768d0dfb-d92f-43cb-a2c4-b68f09cdc76a tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:08.911355 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-768d0dfb-d92f-43cb-a2c4-b68f09cdc76a tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:08.911794 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-768d0dfb-d92f-43cb-a2c4-b68f09cdc76a tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:08.947391 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-768d0dfb-d92f-43cb-a2c4-b68f09cdc76a tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048352 May 19 15:15:08.947960 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 462/923] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:15:08 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 15:15:09.052373 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9e9ca6e3-0379-4e6f-b3d5-eb20cdae81c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:09.053465 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-9e9ca6e3-0379-4e6f-b3d5-eb20cdae81c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:09.059749 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9e9ca6e3-0379-4e6f-b3d5-eb20cdae81c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:09.060151 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9e9ca6e3-0379-4e6f-b3d5-eb20cdae81c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:09.060954 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9e9ca6e3-0379-4e6f-b3d5-eb20cdae81c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:09.061395 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9e9ca6e3-0379-4e6f-b3d5-eb20cdae81c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:09.089310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9e9ca6e3-0379-4e6f-b3d5-eb20cdae81c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041843 May 19 15:15:09.089859 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 462/924] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:15:09 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 15:15:09.147800 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-01ac8e98-f45c-4342-b360-90b33f11880c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:09.148302 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-01ac8e98-f45c-4342-b360-90b33f11880c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:09.154235 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01ac8e98-f45c-4342-b360-90b33f11880c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:09.154761 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01ac8e98-f45c-4342-b360-90b33f11880c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:09.155561 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01ac8e98-f45c-4342-b360-90b33f11880c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:09.156003 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-01ac8e98-f45c-4342-b360-90b33f11880c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:09.180174 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-01ac8e98-f45c-4342-b360-90b33f11880c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:15:09.258060 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-01ac8e98-f45c-4342-b360-90b33f11880c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "DELETE /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 204 len: 0 microversion: 2.1 time: 0.114236 May 19 15:15:09.258638 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 463/925] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:15:09 2022] DELETE /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:15:09.266959 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-eab35a5a-b8a0-476f-8261-3ea0dacb70f5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:09.267591 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-eab35a5a-b8a0-476f-8261-3ea0dacb70f5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:09.274266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-eab35a5a-b8a0-476f-8261-3ea0dacb70f5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:09.274716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-eab35a5a-b8a0-476f-8261-3ea0dacb70f5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:09.275509 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-eab35a5a-b8a0-476f-8261-3ea0dacb70f5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:09.275933 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-eab35a5a-b8a0-476f-8261-3ea0dacb70f5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:09.404645 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-eab35a5a-b8a0-476f-8261-3ea0dacb70f5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:15:09.412204 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-eab35a5a-b8a0-476f-8261-3ea0dacb70f5 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 200 len: 1671 microversion: 2.1 time: 0.149118 May 19 15:15:09.412772 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 463/926] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:15:09 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:15:10.428922 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-1facf779-8c96-4fdd-ade0-2b32a59670a9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:10.429615 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-1facf779-8c96-4fdd-ade0-2b32a59670a9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:10.436060 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1facf779-8c96-4fdd-ade0-2b32a59670a9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:10.436510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1facf779-8c96-4fdd-ade0-2b32a59670a9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:10.437270 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1facf779-8c96-4fdd-ade0-2b32a59670a9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:10.437702 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-1facf779-8c96-4fdd-ade0-2b32a59670a9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:10.574526 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-1facf779-8c96-4fdd-ade0-2b32a59670a9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:15:10.583898 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-1facf779-8c96-4fdd-ade0-2b32a59670a9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 200 len: 1671 microversion: 2.1 time: 0.158970 May 19 15:15:10.584813 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 464/927] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:15:10 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:15:11.602285 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f8ccc6e1-3459-45ca-91b1-75fe4152dcce tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:11.602849 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f8ccc6e1-3459-45ca-91b1-75fe4152dcce tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:11.609840 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f8ccc6e1-3459-45ca-91b1-75fe4152dcce tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:11.610299 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f8ccc6e1-3459-45ca-91b1-75fe4152dcce tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:11.611089 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f8ccc6e1-3459-45ca-91b1-75fe4152dcce tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:11.611563 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f8ccc6e1-3459-45ca-91b1-75fe4152dcce tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:11.797924 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f8ccc6e1-3459-45ca-91b1-75fe4152dcce tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0022fc1107834a5cbe30f0146361213b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b1521fd041a446e851d82487479930b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:15:11.805472 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f8ccc6e1-3459-45ca-91b1-75fe4152dcce tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 200 len: 1671 microversion: 2.1 time: 0.207810 May 19 15:15:11.806611 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 464/928] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:15:11 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 1671 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:15:12.107477 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-8c1be6dd-f81a-47d2-8a73-75c73175cdb9 req-9175c37f-d911-468a-b6e6-0f1e32ea7808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15841fc5-24fd-4346-ace6-e95329a39953", "name": "network-vif-deleted", "tag": "49ab397e-dedd-4bbf-86b5-75a9240c3e82"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:15:12.117208 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-8c1be6dd-f81a-47d2-8a73-75c73175cdb9 req-9175c37f-d911-468a-b6e6-0f1e32ea7808 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:12.117573 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-8c1be6dd-f81a-47d2-8a73-75c73175cdb9 req-9175c37f-d911-468a-b6e6-0f1e32ea7808 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:12.129625 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-8c1be6dd-f81a-47d2-8a73-75c73175cdb9 req-9175c37f-d911-468a-b6e6-0f1e32ea7808 service nova] Creating event network-vif-deleted:49ab397e-dedd-4bbf-86b5-75a9240c3e82 for instance 15841fc5-24fd-4346-ace6-e95329a39953 on hv-cinder-82549 May 19 15:15:12.136116 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-8c1be6dd-f81a-47d2-8a73-75c73175cdb9 req-9175c37f-d911-468a-b6e6-0f1e32ea7808 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032423 May 19 15:15:12.136786 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 465/929] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:15:12.823831 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c864fd1d-d5ad-491a-b645-47f5440974b1 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:12.824448 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c864fd1d-d5ad-491a-b645-47f5440974b1 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:12.831065 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c864fd1d-d5ad-491a-b645-47f5440974b1 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:12.831559 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c864fd1d-d5ad-491a-b645-47f5440974b1 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:12.832337 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c864fd1d-d5ad-491a-b645-47f5440974b1 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:12.832783 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c864fd1d-d5ad-491a-b645-47f5440974b1 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:12.847313 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-c864fd1d-d5ad-491a-b645-47f5440974b1 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] HTTP exception thrown: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c864fd1d-d5ad-491a-b645-47f5440974b1 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Request method failure captured: May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 HTTP/1.1 May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihl39CIi73st8uXzDKGjSW8XonfMbZs0-yWiJNjPJcAtENgCNq936kRMW-zc4wTwLcekaNDdKZGN-iCUghy30e9RBxTQLR2QFpJH6-l1XrZ5aRslL33Df3Wu6faBJQ09ia8QCcYep-PNk6PcEtM-zSlr7gYNh7HO972NvzTeRuV8jgLE May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 5b1521fd041a446e851d82487479930b May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-AttachVolumeTestJSON-428291670 May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:15:12.849127 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:15:12.851399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5b1521fd041a446e851d82487479930b", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5b1521fd041a446e851d82487479930b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5b1521fd041a446e851d82487479930b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5b1521fd041a446e851d82487479930b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:15:12.851399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-AttachVolumeTestJSON-428291670 May 19 15:15:12.851399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 5b1521fd041a446e851d82487479930b May 19 15:15:12.851399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-AttachVolumeTestJSON-428291670 May 19 15:15:12.851399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-AttachVolumeTestJSON-428291670-project May 19 15:15:12.851399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:15:12.851399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:15:12.851399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 0022fc1107834a5cbe30f0146361213b May 19 15:15:12.851399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-AttachVolumeTestJSON-428291670-project May 19 15:15:12.851399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:15:12.851399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. May 19 15:15:12.851399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '15841fc5-24fd-4346-ace6-e95329a39953'} May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:15:12.852251 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. May 19 15:15:12.853666 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:12.854945 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c864fd1d-d5ad-491a-b645-47f5440974b1 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Returning 404 to user: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:15:12.854945 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c864fd1d-d5ad-491a-b645-47f5440974b1 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 404 len: 111 microversion: 2.1 time: 0.031082 May 19 15:15:12.854945 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 465/930] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:15:12 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:15:12.860287 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-fd7ef672-c345-4d54-b6cd-f34548566bb8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '.version_select at 0x7f35d135eee0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:12.878113 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-fd7ef672-c345-4d54-b6cd-f34548566bb8 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-270324715" status: 202 len: 0 microversion: 2.1 time: 0.021866 May 19 15:15:12.879013 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 466/931] 10.222.0.24 () {58 vars in 1217 bytes} [Thu May 19 15:15:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-270324715 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 15:15:15.760598 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4a25f5d4-11fc-495b-bc6d-91f89eb130c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:15.761128 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4a25f5d4-11fc-495b-bc6d-91f89eb130c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:15.767561 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4a25f5d4-11fc-495b-bc6d-91f89eb130c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:15.768053 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4a25f5d4-11fc-495b-bc6d-91f89eb130c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:15.768824 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4a25f5d4-11fc-495b-bc6d-91f89eb130c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:15.769267 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4a25f5d4-11fc-495b-bc6d-91f89eb130c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:15.784450 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-4a25f5d4-11fc-495b-bc6d-91f89eb130c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] HTTP exception thrown: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4a25f5d4-11fc-495b-bc6d-91f89eb130c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Request method failure captured: May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: DELETE /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 HTTP/1.1 May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihl39CIi73st8uXzDKGjSW8XonfMbZs0-yWiJNjPJcAtENgCNq936kRMW-zc4wTwLcekaNDdKZGN-iCUghy30e9RBxTQLR2QFpJH6-l1XrZ5aRslL33Df3Wu6faBJQ09ia8QCcYep-PNk6PcEtM-zSlr7gYNh7HO972NvzTeRuV8jgLE May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 5b1521fd041a446e851d82487479930b May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-AttachVolumeTestJSON-428291670 May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:15:15.786040 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:15:15.787766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5b1521fd041a446e851d82487479930b", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5b1521fd041a446e851d82487479930b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5b1521fd041a446e851d82487479930b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5b1521fd041a446e851d82487479930b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:15:15.787766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-AttachVolumeTestJSON-428291670 May 19 15:15:15.787766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 5b1521fd041a446e851d82487479930b May 19 15:15:15.787766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-AttachVolumeTestJSON-428291670 May 19 15:15:15.787766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-AttachVolumeTestJSON-428291670-project May 19 15:15:15.787766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:15:15.787766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:15:15.787766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 0022fc1107834a5cbe30f0146361213b May 19 15:15:15.787766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-AttachVolumeTestJSON-428291670-project May 19 15:15:15.787766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:15:15.787766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. May 19 15:15:15.787766 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '15841fc5-24fd-4346-ace6-e95329a39953'} May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:15:15.789074 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. May 19 15:15:15.791725 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:15.794558 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4a25f5d4-11fc-495b-bc6d-91f89eb130c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Returning 404 to user: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:15:15.794558 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4a25f5d4-11fc-495b-bc6d-91f89eb130c9 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "DELETE /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 404 len: 111 microversion: 2.1 time: 0.030734 May 19 15:15:15.794558 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 466/932] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:15:15 2022] DELETE /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:15:15.798453 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cf6b988e-a4d4-4dae-8e1c-302cebcff43c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:15.799237 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-cf6b988e-a4d4-4dae-8e1c-302cebcff43c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: 15841fc5-24fd-4346-ace6-e95329a39953] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:15.801157 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:15.807620 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cf6b988e-a4d4-4dae-8e1c-302cebcff43c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:15.808157 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cf6b988e-a4d4-4dae-8e1c-302cebcff43c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:15.808931 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cf6b988e-a4d4-4dae-8e1c-302cebcff43c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:15.809414 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-cf6b988e-a4d4-4dae-8e1c-302cebcff43c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:15.824654 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-cf6b988e-a4d4-4dae-8e1c-302cebcff43c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] HTTP exception thrown: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cf6b988e-a4d4-4dae-8e1c-302cebcff43c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Request method failure captured: May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 HTTP/1.1 May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihl39CIi73st8uXzDKGjSW8XonfMbZs0-yWiJNjPJcAtENgCNq936kRMW-zc4wTwLcekaNDdKZGN-iCUghy30e9RBxTQLR2QFpJH6-l1XrZ5aRslL33Df3Wu6faBJQ09ia8QCcYep-PNk6PcEtM-zSlr7gYNh7HO972NvzTeRuV8jgLE May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 5b1521fd041a446e851d82487479930b May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeTestJSON-428291670 May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:15:15.826417 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:15:15.828059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5b1521fd041a446e851d82487479930b", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5b1521fd041a446e851d82487479930b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5b1521fd041a446e851d82487479930b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5b1521fd041a446e851d82487479930b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:15:15.828059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeTestJSON-428291670 May 19 15:15:15.828059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 5b1521fd041a446e851d82487479930b May 19 15:15:15.828059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeTestJSON-428291670 May 19 15:15:15.828059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeTestJSON-428291670-project May 19 15:15:15.828059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:15:15.828059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:15:15.828059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: 0022fc1107834a5cbe30f0146361213b May 19 15:15:15.828059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeTestJSON-428291670-project May 19 15:15:15.828059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:15:15.828059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. May 19 15:15:15.828059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': '15841fc5-24fd-4346-ace6-e95329a39953'} May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:15:15.828961 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. May 19 15:15:15.830468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:15.831816 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-cf6b988e-a4d4-4dae-8e1c-302cebcff43c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Returning 404 to user: Instance 15841fc5-24fd-4346-ace6-e95329a39953 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:15:15.831816 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-cf6b988e-a4d4-4dae-8e1c-302cebcff43c tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953" status: 404 len: 111 microversion: 2.1 time: 0.034751 May 19 15:15:15.831816 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 467/933] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:15:15 2022] GET /compute/v2.1/servers/15841fc5-24fd-4346-ace6-e95329a39953 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:15:16.970413 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-133d44d7-fd25-4d2f-95c1-ac716e0e6ab2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:16.970907 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-133d44d7-fd25-4d2f-95c1-ac716e0e6ab2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:16.973355 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:16.978614 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-133d44d7-fd25-4d2f-95c1-ac716e0e6ab2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:16.979063 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-133d44d7-fd25-4d2f-95c1-ac716e0e6ab2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:16.979870 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-133d44d7-fd25-4d2f-95c1-ac716e0e6ab2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:16.980311 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-133d44d7-fd25-4d2f-95c1-ac716e0e6ab2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:16.994568 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-133d44d7-fd25-4d2f-95c1-ac716e0e6ab2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] HTTP exception thrown: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-133d44d7-fd25-4d2f-95c1-ac716e0e6ab2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Request method failure captured: May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: DELETE /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 HTTP/1.1 May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihl39CIi73st8uXzDKGjSW8XonfMbZs0-yWiJNjPJcAtENgCNq936kRMW-zc4wTwLcekaNDdKZGN-iCUghy30e9RBxTQLR2QFpJH6-l1XrZ5aRslL33Df3Wu6faBJQ09ia8QCcYep-PNk6PcEtM-zSlr7gYNh7HO972NvzTeRuV8jgLE May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 5b1521fd041a446e851d82487479930b May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-AttachVolumeTestJSON-428291670 May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:15:16.996380 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:15:16.998011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5b1521fd041a446e851d82487479930b", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5b1521fd041a446e851d82487479930b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5b1521fd041a446e851d82487479930b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5b1521fd041a446e851d82487479930b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:15:16.998011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-AttachVolumeTestJSON-428291670 May 19 15:15:16.998011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 5b1521fd041a446e851d82487479930b May 19 15:15:16.998011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-AttachVolumeTestJSON-428291670 May 19 15:15:16.998011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-AttachVolumeTestJSON-428291670-project May 19 15:15:16.998011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:15:16.998011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:15:16.998011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 0022fc1107834a5cbe30f0146361213b May 19 15:15:16.998011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-AttachVolumeTestJSON-428291670-project May 19 15:15:16.998011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:15:16.998011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. May 19 15:15:16.998011 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': 'f20c74e3-1f32-4118-b98b-2e60725d9ea2'} May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:15:16.998953 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. May 19 15:15:17.000507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:17.002026 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-133d44d7-fd25-4d2f-95c1-ac716e0e6ab2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Returning 404 to user: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:15:17.002026 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-133d44d7-fd25-4d2f-95c1-ac716e0e6ab2 tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 404 len: 111 microversion: 2.1 time: 0.031275 May 19 15:15:17.002026 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 467/934] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:15:16 2022] DELETE /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:15:17.006960 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a1d7f687-70fc-4985-ac3e-38dcd3a7512d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:17.007608 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a1d7f687-70fc-4985-ac3e-38dcd3a7512d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] [instance: f20c74e3-1f32-4118-b98b-2e60725d9ea2] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:17.014096 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1d7f687-70fc-4985-ac3e-38dcd3a7512d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:17.014552 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1d7f687-70fc-4985-ac3e-38dcd3a7512d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:17.015346 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1d7f687-70fc-4985-ac3e-38dcd3a7512d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:17.015790 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1d7f687-70fc-4985-ac3e-38dcd3a7512d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:17.031180 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-a1d7f687-70fc-4985-ac3e-38dcd3a7512d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] HTTP exception thrown: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a1d7f687-70fc-4985-ac3e-38dcd3a7512d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Request method failure captured: May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 HTTP/1.1 May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihl39CIi73st8uXzDKGjSW8XonfMbZs0-yWiJNjPJcAtENgCNq936kRMW-zc4wTwLcekaNDdKZGN-iCUghy30e9RBxTQLR2QFpJH6-l1XrZ5aRslL33Df3Wu6faBJQ09ia8QCcYep-PNk6PcEtM-zSlr7gYNh7HO972NvzTeRuV8jgLE May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 5b1521fd041a446e851d82487479930b May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-AttachVolumeTestJSON-428291670 May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:15:17.032704 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:15:17.034300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_5b1521fd041a446e851d82487479930b", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5b1521fd041a446e851d82487479930b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/5b1521fd041a446e851d82487479930b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/5b1521fd041a446e851d82487479930b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:15:17.034300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-AttachVolumeTestJSON-428291670 May 19 15:15:17.034300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 5b1521fd041a446e851d82487479930b May 19 15:15:17.034300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-AttachVolumeTestJSON-428291670 May 19 15:15:17.034300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-AttachVolumeTestJSON-428291670-project May 19 15:15:17.034300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:15:17.034300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:15:17.034300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: 0022fc1107834a5cbe30f0146361213b May 19 15:15:17.034300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-AttachVolumeTestJSON-428291670-project May 19 15:15:17.034300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:15:17.034300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. May 19 15:15:17.034300 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': 'f20c74e3-1f32-4118-b98b-2e60725d9ea2'} May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:15:17.035169 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. May 19 15:15:17.036703 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:17.038086 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a1d7f687-70fc-4985-ac3e-38dcd3a7512d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] Returning 404 to user: Instance f20c74e3-1f32-4118-b98b-2e60725d9ea2 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:15:17.038086 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a1d7f687-70fc-4985-ac3e-38dcd3a7512d tempest-AttachVolumeTestJSON-428291670 tempest-AttachVolumeTestJSON-428291670-project] 10.222.0.24 "GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2" status: 404 len: 111 microversion: 2.1 time: 0.031909 May 19 15:15:17.038086 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 468/935] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:15:17 2022] GET /compute/v2.1/servers/f20c74e3-1f32-4118-b98b-2e60725d9ea2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 15:15:32.445048 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c3c6567f-f8bd-4747-b0cc-7f1e666c81a7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:32.446256 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c3c6567f-f8bd-4747-b0cc-7f1e666c81a7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:32.449114 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=2 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:32.449738 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:32.451716 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-5af2205c-4ea3-428f-a88c-f85de751ea15 req-64b40beb-84f3-4c77-acf5-b3fc24517ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0e40dd3-1bc8-4d72-a975-272c4b6c8b68", "tag": "ed53e5b3-4733-49ad-b67b-e85553de91fa"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:15:32.457304 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c3c6567f-f8bd-4747-b0cc-7f1e666c81a7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:32.458013 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c3c6567f-f8bd-4747-b0cc-7f1e666c81a7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:32.458814 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:32.459052 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c3c6567f-f8bd-4747-b0cc-7f1e666c81a7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:32.460061 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:15:32.460514 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c3c6567f-f8bd-4747-b0cc-7f1e666c81a7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:32.462381 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-5af2205c-4ea3-428f-a88c-f85de751ea15 req-64b40beb-84f3-4c77-acf5-b3fc24517ca4 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:32.462857 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-5af2205c-4ea3-428f-a88c-f85de751ea15 req-64b40beb-84f3-4c77-acf5-b3fc24517ca4 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:32.475722 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-5af2205c-4ea3-428f-a88c-f85de751ea15 req-64b40beb-84f3-4c77-acf5-b3fc24517ca4 service nova] Creating event network-changed:ed53e5b3-4733-49ad-b67b-e85553de91fa for instance f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 on hv-cinder-82549 May 19 15:15:32.480919 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-5af2205c-4ea3-428f-a88c-f85de751ea15 req-64b40beb-84f3-4c77-acf5-b3fc24517ca4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032814 May 19 15:15:32.481829 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 469/936] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:15:32.487821 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c3c6567f-f8bd-4747-b0cc-7f1e666c81a7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Going to try to terminate instance {{(pid=117445) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:15:32.575462 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c3c6567f-f8bd-4747-b0cc-7f1e666c81a7 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 204 len: 0 microversion: 2.1 time: 0.135053 May 19 15:15:32.576841 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 468/937] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:15:32 2022] DELETE /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:15:32.586744 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8af7037e-28e3-4985-8573-de9a5e9743ca tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:32.587519 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8af7037e-28e3-4985-8573-de9a5e9743ca tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:32.594640 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8af7037e-28e3-4985-8573-de9a5e9743ca tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:32.595103 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8af7037e-28e3-4985-8573-de9a5e9743ca tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:32.596047 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8af7037e-28e3-4985-8573-de9a5e9743ca tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:32.596494 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8af7037e-28e3-4985-8573-de9a5e9743ca tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:32.930506 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8af7037e-28e3-4985-8573-de9a5e9743ca tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:15:32.938466 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8af7037e-28e3-4985-8573-de9a5e9743ca tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1575 microversion: 2.1 time: 0.357007 May 19 15:15:32.947536 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 470/938] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:15:32 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1575 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:15:33.957308 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f7bb0be4-87d8-4a5d-be5c-ffb3b5d1d040 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:33.958042 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f7bb0be4-87d8-4a5d-be5c-ffb3b5d1d040 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:33.964507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7bb0be4-87d8-4a5d-be5c-ffb3b5d1d040 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:33.964961 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7bb0be4-87d8-4a5d-be5c-ffb3b5d1d040 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:33.965740 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7bb0be4-87d8-4a5d-be5c-ffb3b5d1d040 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:33.966180 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7bb0be4-87d8-4a5d-be5c-ffb3b5d1d040 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:34.237396 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f7bb0be4-87d8-4a5d-be5c-ffb3b5d1d040 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:15:34.249674 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f7bb0be4-87d8-4a5d-be5c-ffb3b5d1d040 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 200 len: 1575 microversion: 2.1 time: 0.293210 May 19 15:15:34.250522 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 469/939] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:15:33 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 1575 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:15:34.618751 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-43a39b4c-6aeb-43dd-ae7c-dbeab952371f req-14a3631a-b104-446a-a810-99189ae814dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e40dd3-1bc8-4d72-a975-272c4b6c8b68", "name": "network-vif-deleted", "tag": "ed53e5b3-4733-49ad-b67b-e85553de91fa"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:15:34.628454 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-43a39b4c-6aeb-43dd-ae7c-dbeab952371f req-14a3631a-b104-446a-a810-99189ae814dc service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:34.629402 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-43a39b4c-6aeb-43dd-ae7c-dbeab952371f req-14a3631a-b104-446a-a810-99189ae814dc service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:34.641170 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-43a39b4c-6aeb-43dd-ae7c-dbeab952371f req-14a3631a-b104-446a-a810-99189ae814dc service nova] Creating event network-vif-deleted:ed53e5b3-4733-49ad-b67b-e85553de91fa for instance f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 on hv-cinder-82549 May 19 15:15:34.645844 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-43a39b4c-6aeb-43dd-ae7c-dbeab952371f req-14a3631a-b104-446a-a810-99189ae814dc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030941 May 19 15:15:34.646433 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 471/940] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:15:35.267510 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3881858f-63aa-4442-837c-b8c99a5d2f67 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:35.268985 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-3881858f-63aa-4442-837c-b8c99a5d2f67 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: f0e40dd3-1bc8-4d72-a975-272c4b6c8b68] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:35.276363 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3881858f-63aa-4442-837c-b8c99a5d2f67 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:35.276825 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3881858f-63aa-4442-837c-b8c99a5d2f67 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:35.277606 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3881858f-63aa-4442-837c-b8c99a5d2f67 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:35.278049 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-3881858f-63aa-4442-837c-b8c99a5d2f67 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:35.293227 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-3881858f-63aa-4442-837c-b8c99a5d2f67 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] HTTP exception thrown: Instance f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 could not be found. May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3881858f-63aa-4442-837c-b8c99a5d2f67 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Request method failure captured: May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 HTTP/1.1 May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihl1BvK4FVLhQp8fmrOD3HDkNabIZHMyu1Qkda5ry3i8u1dZf2C9j28bYeZWARdOYsaFtdcD24rO8SbDeEgfFXKqbY8KgMnYRLzfTpjabFplhT8CqU0xt1lrLplZmZ6LMGhKB0dErYLv5NCH30jsKrc6xvkjg9ycO6_07Yng8z-8RU3s May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 2c71bc8f0a164884bc0c046fd1e7faab May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-TestVolumeBootPattern-755449471 May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:15:35.295100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:15:35.296755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2c71bc8f0a164884bc0c046fd1e7faab", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2c71bc8f0a164884bc0c046fd1e7faab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2c71bc8f0a164884bc0c046fd1e7faab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2c71bc8f0a164884bc0c046fd1e7faab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:15:35.296755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-TestVolumeBootPattern-755449471 May 19 15:15:35.296755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 2c71bc8f0a164884bc0c046fd1e7faab May 19 15:15:35.296755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-TestVolumeBootPattern-755449471 May 19 15:15:35.296755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-TestVolumeBootPattern-755449471-project May 19 15:15:35.296755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:15:35.296755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:15:35.296755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 9877b9bbc14141bba21625fc8f1046d2 May 19 15:15:35.296755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-TestVolumeBootPattern-755449471-project May 19 15:15:35.296755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:15:35.296755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 could not be found. May 19 15:15:35.296755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': 'f0e40dd3-1bc8-4d72-a975-272c4b6c8b68'} May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 could not be found. May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:15:35.297622 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 could not be found. May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 could not be found. May 19 15:15:35.298995 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:35.301519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-3881858f-63aa-4442-837c-b8c99a5d2f67 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Returning 404 to user: Instance f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:15:35.301519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-3881858f-63aa-4442-837c-b8c99a5d2f67 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68" status: 404 len: 111 microversion: 2.1 time: 0.033430 May 19 15:15:35.301519 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 470/941] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:15:35 2022] GET /compute/v2.1/servers/f0e40dd3-1bc8-4d72-a975-272c4b6c8b68 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:15:38.941066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-aa5d6de9-4318-4b42-998a-e7db0977677c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:38.941664 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-aa5d6de9-4318-4b42-998a-e7db0977677c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:38.944840 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-3b32684a-2899-4f45-a0fc-fad44f52d27a req-e9ba60b7-ffee-4320-904d-2e4df4412610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0116d16f-6546-42a0-8274-22fc3577000b", "tag": "a9f91331-2ea7-4396-8799-ffc363f22091"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:15:38.950232 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aa5d6de9-4318-4b42-998a-e7db0977677c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:38.950821 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aa5d6de9-4318-4b42-998a-e7db0977677c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:38.951693 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aa5d6de9-4318-4b42-998a-e7db0977677c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:38.952391 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-aa5d6de9-4318-4b42-998a-e7db0977677c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:38.957743 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-3b32684a-2899-4f45-a0fc-fad44f52d27a req-e9ba60b7-ffee-4320-904d-2e4df4412610 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:38.958193 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-3b32684a-2899-4f45-a0fc-fad44f52d27a req-e9ba60b7-ffee-4320-904d-2e4df4412610 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:38.975676 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-3b32684a-2899-4f45-a0fc-fad44f52d27a req-e9ba60b7-ffee-4320-904d-2e4df4412610 service nova] Creating event network-changed:a9f91331-2ea7-4396-8799-ffc363f22091 for instance 0116d16f-6546-42a0-8274-22fc3577000b on hv-cinder-82549 May 19 15:15:38.979889 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-aa5d6de9-4318-4b42-998a-e7db0977677c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:15:38.980803 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-3b32684a-2899-4f45-a0fc-fad44f52d27a req-e9ba60b7-ffee-4320-904d-2e4df4412610 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040633 May 19 15:15:38.981709 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 471/942] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:15:39.074796 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-aa5d6de9-4318-4b42-998a-e7db0977677c tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "DELETE /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 204 len: 0 microversion: 2.1 time: 0.137611 May 19 15:15:39.075547 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 472/943] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:15:38 2022] DELETE /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:15:39.089777 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-9d47c302-c5e1-42b9-83c7-20d31aaae35f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:39.090491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-9d47c302-c5e1-42b9-83c7-20d31aaae35f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:39.096823 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9d47c302-c5e1-42b9-83c7-20d31aaae35f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:39.097277 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9d47c302-c5e1-42b9-83c7-20d31aaae35f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:39.098051 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9d47c302-c5e1-42b9-83c7-20d31aaae35f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:39.098491 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-9d47c302-c5e1-42b9-83c7-20d31aaae35f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:39.235711 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-9d47c302-c5e1-42b9-83c7-20d31aaae35f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:15:39.243598 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-9d47c302-c5e1-42b9-83c7-20d31aaae35f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1458 microversion: 2.1 time: 0.162300 May 19 15:15:39.244172 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 472/944] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:15:39 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1458 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:15:40.263666 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-200e6487-0012-4b25-b56f-6ddf60cfea09 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:40.264594 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-200e6487-0012-4b25-b56f-6ddf60cfea09 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:40.272824 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-200e6487-0012-4b25-b56f-6ddf60cfea09 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:40.273383 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-200e6487-0012-4b25-b56f-6ddf60cfea09 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:40.274398 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-200e6487-0012-4b25-b56f-6ddf60cfea09 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:40.274906 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-200e6487-0012-4b25-b56f-6ddf60cfea09 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:40.421638 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-200e6487-0012-4b25-b56f-6ddf60cfea09 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:15:40.432878 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-200e6487-0012-4b25-b56f-6ddf60cfea09 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1458 microversion: 2.1 time: 0.174291 May 19 15:15:40.444103 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 473/945] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:15:40 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1458 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:15:41.109270 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-e2217b2a-14c0-4aae-ad15-59a39cea0b66 req-0335a393-c054-48eb-b821-ee49857c5137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0116d16f-6546-42a0-8274-22fc3577000b", "name": "network-vif-deleted", "tag": "a9f91331-2ea7-4396-8799-ffc363f22091"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:15:41.118956 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-e2217b2a-14c0-4aae-ad15-59a39cea0b66 req-0335a393-c054-48eb-b821-ee49857c5137 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:41.119356 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-e2217b2a-14c0-4aae-ad15-59a39cea0b66 req-0335a393-c054-48eb-b821-ee49857c5137 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:41.130944 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-e2217b2a-14c0-4aae-ad15-59a39cea0b66 req-0335a393-c054-48eb-b821-ee49857c5137 service nova] Creating event network-vif-deleted:a9f91331-2ea7-4396-8799-ffc363f22091 for instance 0116d16f-6546-42a0-8274-22fc3577000b on hv-cinder-82549 May 19 15:15:41.136592 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-e2217b2a-14c0-4aae-ad15-59a39cea0b66 req-0335a393-c054-48eb-b821-ee49857c5137 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030967 May 19 15:15:41.137153 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 473/946] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:15:41.451004 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-067c5c7b-9668-470e-955f-18d2a3822535 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:41.451733 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-067c5c7b-9668-470e-955f-18d2a3822535 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:41.458488 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-067c5c7b-9668-470e-955f-18d2a3822535 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:41.458952 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-067c5c7b-9668-470e-955f-18d2a3822535 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:41.460260 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-067c5c7b-9668-470e-955f-18d2a3822535 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:41.460702 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-067c5c7b-9668-470e-955f-18d2a3822535 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:41.536124 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-067c5c7b-9668-470e-955f-18d2a3822535 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9877b9bbc14141bba21625fc8f1046d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c71bc8f0a164884bc0c046fd1e7faab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:15:41.553148 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-067c5c7b-9668-470e-955f-18d2a3822535 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 200 len: 1225 microversion: 2.1 time: 0.105956 May 19 15:15:41.553723 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 474/947] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:15:41 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:15:42.472958 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:15:42.473479 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Thu May 19 15:15:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 15:15:42.570956 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7364ebcb-2b23-4f74-acbd-14017b04cd21 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:42.571755 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-7364ebcb-2b23-4f74-acbd-14017b04cd21 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: 0116d16f-6546-42a0-8274-22fc3577000b] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:42.577845 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7364ebcb-2b23-4f74-acbd-14017b04cd21 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:42.578289 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7364ebcb-2b23-4f74-acbd-14017b04cd21 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:42.579047 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7364ebcb-2b23-4f74-acbd-14017b04cd21 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:42.579522 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-7364ebcb-2b23-4f74-acbd-14017b04cd21 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:42.592420 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-7364ebcb-2b23-4f74-acbd-14017b04cd21 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] HTTP exception thrown: Instance 0116d16f-6546-42a0-8274-22fc3577000b could not be found. May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7364ebcb-2b23-4f74-acbd-14017b04cd21 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Request method failure captured: May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b HTTP/1.1 May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihl1BvK4FVLhQp8fmrOD3HDkNabIZHMyu1Qkda5ry3i8u1dZf2C9j28bYeZWARdOYsaFtdcD24rO8SbDeEgfFXKqbY8KgMnYRLzfTpjabFplhT8CqU0xt1lrLplZmZ6LMGhKB0dErYLv5NCH30jsKrc6xvkjg9ycO6_07Yng8z-8RU3s May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 2c71bc8f0a164884bc0c046fd1e7faab May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-TestVolumeBootPattern-755449471 May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:15:42.594100 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:15:42.595770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2c71bc8f0a164884bc0c046fd1e7faab", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2c71bc8f0a164884bc0c046fd1e7faab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2c71bc8f0a164884bc0c046fd1e7faab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2c71bc8f0a164884bc0c046fd1e7faab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:15:42.595770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-TestVolumeBootPattern-755449471 May 19 15:15:42.595770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 2c71bc8f0a164884bc0c046fd1e7faab May 19 15:15:42.595770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-TestVolumeBootPattern-755449471 May 19 15:15:42.595770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-TestVolumeBootPattern-755449471-project May 19 15:15:42.595770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:15:42.595770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:15:42.595770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 9877b9bbc14141bba21625fc8f1046d2 May 19 15:15:42.595770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-TestVolumeBootPattern-755449471-project May 19 15:15:42.595770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:15:42.595770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance 0116d16f-6546-42a0-8274-22fc3577000b could not be found. May 19 15:15:42.595770 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': '0116d16f-6546-42a0-8274-22fc3577000b'} May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0116d16f-6546-42a0-8274-22fc3577000b could not be found. May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:15:42.596689 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0116d16f-6546-42a0-8274-22fc3577000b could not be found. May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0116d16f-6546-42a0-8274-22fc3577000b could not be found. May 19 15:15:42.598209 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:42.599620 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-7364ebcb-2b23-4f74-acbd-14017b04cd21 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Returning 404 to user: Instance 0116d16f-6546-42a0-8274-22fc3577000b could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:15:42.599620 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-7364ebcb-2b23-4f74-acbd-14017b04cd21 tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b" status: 404 len: 111 microversion: 2.1 time: 0.029500 May 19 15:15:42.599620 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 474/948] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:15:42 2022] GET /compute/v2.1/servers/0116d16f-6546-42a0-8274-22fc3577000b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:15:43.026549 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9719593b-9e5b-4ab9-9119-c77778d2f17f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:43.027068 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9719593b-9e5b-4ab9-9119-c77778d2f17f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:43.033825 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9719593b-9e5b-4ab9-9119-c77778d2f17f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:43.034277 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9719593b-9e5b-4ab9-9119-c77778d2f17f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:43.035057 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9719593b-9e5b-4ab9-9119-c77778d2f17f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:43.035505 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9719593b-9e5b-4ab9-9119-c77778d2f17f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:43.049407 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.wsgi [None req-9719593b-9e5b-4ab9-9119-c77778d2f17f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] HTTP exception thrown: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9719593b-9e5b-4ab9-9119-c77778d2f17f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Request method failure captured: May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: request: DELETE /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 HTTP/1.1 May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept: application/json May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Accept-Encoding: identity May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Connection: close May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Length: 0 May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Content-Type: application/json May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Host: 10.222.0.24 May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Openstack-System-Scope: None May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: User-Agent: python-urllib3/1.26.9 May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Auth-Token: gAAAAABihl1BvK4FVLhQp8fmrOD3HDkNabIZHMyu1Qkda5ry3i8u1dZf2C9j28bYeZWARdOYsaFtdcD24rO8SbDeEgfFXKqbY8KgMnYRLzfTpjabFplhT8CqU0xt1lrLplZmZ6LMGhKB0dErYLv5NCH30jsKrc6xvkjg9ycO6_07Yng8z-8RU3s May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Id: None May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Domain-Name: None May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Identity-Status: Confirmed May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Is-Admin-Project: True May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Id: default May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Domain-Name: Default May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Id: 2c71bc8f0a164884bc0c046fd1e7faab May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Project-Name: tempest-TestVolumeBootPattern-755449471 May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Role: member,reader May 19 15:15:43.051066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Roles: member,reader May 19 15:15:43.052635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2c71bc8f0a164884bc0c046fd1e7faab", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2c71bc8f0a164884bc0c046fd1e7faab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2c71bc8f0a164884bc0c046fd1e7faab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2c71bc8f0a164884bc0c046fd1e7faab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:15:43.052635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant: tempest-TestVolumeBootPattern-755449471 May 19 15:15:43.052635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Id: 2c71bc8f0a164884bc0c046fd1e7faab May 19 15:15:43.052635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-Tenant-Name: tempest-TestVolumeBootPattern-755449471 May 19 15:15:43.052635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User: tempest-TestVolumeBootPattern-755449471-project May 19 15:15:43.052635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Id: default May 19 15:15:43.052635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Domain-Name: Default May 19 15:15:43.052635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Id: 9877b9bbc14141bba21625fc8f1046d2 May 19 15:15:43.052635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: X-User-Name: tempest-TestVolumeBootPattern-755449471-project May 19 15:15:43.052635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: method: > May 19 15:15:43.052635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: exception: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. May 19 15:15:43.052635 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: action_args: {'id': 'a43fdf07-dfad-4813-9f02-1de4e886eb18'} May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:15:43.053593 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. May 19 15:15:43.055062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: ERROR nova.api.openstack.wsgi May 19 15:15:43.056632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9719593b-9e5b-4ab9-9119-c77778d2f17f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Returning 404 to user: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. {{(pid=117444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:15:43.056632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9719593b-9e5b-4ab9-9119-c77778d2f17f tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 404 len: 111 microversion: 2.1 time: 0.029906 May 19 15:15:43.056632 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 475/949] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:15:43 2022] DELETE /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:15:43.061233 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-8e90cf4b-c84c-4c0b-8e4c-8875061fce5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:43.061841 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-8e90cf4b-c84c-4c0b-8e4c-8875061fce5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] [instance: a43fdf07-dfad-4813-9f02-1de4e886eb18] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:15:43.067817 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8e90cf4b-c84c-4c0b-8e4c-8875061fce5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:43.068274 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8e90cf4b-c84c-4c0b-8e4c-8875061fce5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:43.069030 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8e90cf4b-c84c-4c0b-8e4c-8875061fce5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:15:43.069459 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8e90cf4b-c84c-4c0b-8e4c-8875061fce5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:15:43.085191 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-8e90cf4b-c84c-4c0b-8e4c-8875061fce5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] HTTP exception thrown: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-8e90cf4b-c84c-4c0b-8e4c-8875061fce5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Request method failure captured: May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 HTTP/1.1 May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihl1BvK4FVLhQp8fmrOD3HDkNabIZHMyu1Qkda5ry3i8u1dZf2C9j28bYeZWARdOYsaFtdcD24rO8SbDeEgfFXKqbY8KgMnYRLzfTpjabFplhT8CqU0xt1lrLplZmZ6LMGhKB0dErYLv5NCH30jsKrc6xvkjg9ycO6_07Yng8z-8RU3s May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 2c71bc8f0a164884bc0c046fd1e7faab May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-TestVolumeBootPattern-755449471 May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:15:43.086687 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:15:43.088383 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2c71bc8f0a164884bc0c046fd1e7faab", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2c71bc8f0a164884bc0c046fd1e7faab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2c71bc8f0a164884bc0c046fd1e7faab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2c71bc8f0a164884bc0c046fd1e7faab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:15:43.088383 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-TestVolumeBootPattern-755449471 May 19 15:15:43.088383 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 2c71bc8f0a164884bc0c046fd1e7faab May 19 15:15:43.088383 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-TestVolumeBootPattern-755449471 May 19 15:15:43.088383 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-TestVolumeBootPattern-755449471-project May 19 15:15:43.088383 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:15:43.088383 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:15:43.088383 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 9877b9bbc14141bba21625fc8f1046d2 May 19 15:15:43.088383 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-TestVolumeBootPattern-755449471-project May 19 15:15:43.088383 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:15:43.088383 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. May 19 15:15:43.088383 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': 'a43fdf07-dfad-4813-9f02-1de4e886eb18'} May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:15:43.089275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. May 19 15:15:43.090805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:15:43.092243 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-8e90cf4b-c84c-4c0b-8e4c-8875061fce5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Returning 404 to user: Instance a43fdf07-dfad-4813-9f02-1de4e886eb18 could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:15:43.092243 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-8e90cf4b-c84c-4c0b-8e4c-8875061fce5b tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18" status: 404 len: 111 microversion: 2.1 time: 0.030615 May 19 15:15:43.092243 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 475/950] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:15:43 2022] GET /compute/v2.1/servers/a43fdf07-dfad-4813-9f02-1de4e886eb18 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:15:44.381414 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6d589a17-f519-490e-9d8f-36ebc03a826d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] Calling method '.version_select at 0x7f35d133d3a0>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:15:44.402775 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6d589a17-f519-490e-9d8f-36ebc03a826d tempest-TestVolumeBootPattern-755449471 tempest-TestVolumeBootPattern-755449471-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1235658748" status: 202 len: 0 microversion: 2.1 time: 0.025369 May 19 15:15:44.403762 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 476/951] 10.222.0.24 () {58 vars in 1262 bytes} [Thu May 19 15:15:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1235658748 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:16:22.285428 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-90216d6f-44d6-47a3-bf60-2661c3c80dd5 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Action: 'create', calling method: .version_select at 0x7f35d155c1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-774751696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx1Be+x2pd/wH3vhsdZoeH3WE5IiKwOoupiqcOTcACJf0XVdBo5pwshJzm5trbdgePLMnAyPO8dNLx4x5SZK1a6K8FRp+1SHEY+S3xYjKZ2NYR7y/Xslr46Ux4wxFAH2w=="}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:16:22.289495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:22.290154 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:22.305541 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-90216d6f-44d6-47a3-bf60-2661c3c80dd5 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Getting quotas for project 75c950a99db0449d914183ad7ca845a7. Resources: {'key_pairs'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:16:22.309377 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.quota [None req-90216d6f-44d6-47a3-bf60-2661c3c80dd5 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Getting quotas for user 6c9b6e614944426fb39c3784a21bbf3b and project 75c950a99db0449d914183ad7ca845a7. Resources: {'key_pairs'} {{(pid=117445) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:16:22.332231 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-90216d6f-44d6-47a3-bf60-2661c3c80dd5 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050436 May 19 15:16:22.332835 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 476/952] 10.222.0.24 () {60 vars in 1158 bytes} [Thu May 19 15:16:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:16:22.427874 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:22.428651 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:22.433172 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-537695252", "imageRef": "d7487038-897d-488a-8761-10111182a8ac", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-774751696", "networks": [{"uuid": "4a206ead-ecda-4875-a659-fd257793553f"}]}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:16:22.486965 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.network.neutron [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] validate_networks() for [('4a206ead-ecda-4875-a659-fd257793553f', None, None, None, None, None)] {{(pid=117444) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 15:16:22.943620 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Flavor limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 15:16:22.944051 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Image limits 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 15:16:22.944525 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Flavor pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 15:16:22.944934 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Image pref 0:0:0 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 15:16:22.945343 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.virt.hardware [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117444) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 15:16:22.954112 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:22.954559 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:22.955411 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:22.955854 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:22.972011 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Getting quotas for project 75c950a99db0449d914183ad7ca845a7. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 15:16:22.976434 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.quota [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Getting quotas for user 6c9b6e614944426fb39c3784a21bbf3b and project 75c950a99db0449d914183ad7ca845a7. Resources: {'cores', 'instances', 'ram'} {{(pid=117444) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 15:16:22.987154 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Going to run 1 instances... {{(pid=117444) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 15:16:22.989287 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d7487038-897d-488a-8761-10111182a8ac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117444) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 15:16:23.033725 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-6dadaaea-4c17-4cb5-8eb1-a67cea26bc8d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607494 May 19 15:16:23.034377 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 477/953] 10.222.0.24 () {60 vars in 1146 bytes} [Thu May 19 15:16:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 15:16:23.044818 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-edab64b4-3445-45c5-979c-5efc26e0a171 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:23.045444 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-edab64b4-3445-45c5-979c-5efc26e0a171 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:23.104185 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-edab64b4-3445-45c5-979c-5efc26e0a171 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:23.110799 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-edab64b4-3445-45c5-979c-5efc26e0a171 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1257 microversion: 2.1 time: 0.069938 May 19 15:16:23.111399 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 477/954] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:23 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:24.128443 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b47710e3-3ce9-4d9d-a631-79a6d6b85467 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:24.129209 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b47710e3-3ce9-4d9d-a631-79a6d6b85467 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:24.149045 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b47710e3-3ce9-4d9d-a631-79a6d6b85467 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:24.149627 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b47710e3-3ce9-4d9d-a631-79a6d6b85467 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:24.150494 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b47710e3-3ce9-4d9d-a631-79a6d6b85467 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:24.150958 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b47710e3-3ce9-4d9d-a631-79a6d6b85467 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:24.252510 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b47710e3-3ce9-4d9d-a631-79a6d6b85467 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:24.260588 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b47710e3-3ce9-4d9d-a631-79a6d6b85467 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1327 microversion: 2.1 time: 0.136304 May 19 15:16:24.261153 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 478/955] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:24 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1327 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:25.277992 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-5841ab6f-e59b-485f-b5af-4f8cff4ff24b tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:25.278601 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-5841ab6f-e59b-485f-b5af-4f8cff4ff24b tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:25.294982 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5841ab6f-e59b-485f-b5af-4f8cff4ff24b tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:25.295742 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5841ab6f-e59b-485f-b5af-4f8cff4ff24b tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:25.296539 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5841ab6f-e59b-485f-b5af-4f8cff4ff24b tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:25.297150 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-5841ab6f-e59b-485f-b5af-4f8cff4ff24b tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:25.450136 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-5841ab6f-e59b-485f-b5af-4f8cff4ff24b tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:25.457692 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-5841ab6f-e59b-485f-b5af-4f8cff4ff24b tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1357 microversion: 2.1 time: 0.183596 May 19 15:16:25.458478 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 478/956] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:25 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:26.475043 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c4e06014-a4fe-4912-8bb0-6e9074eedc4d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:26.475921 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c4e06014-a4fe-4912-8bb0-6e9074eedc4d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:26.482452 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c4e06014-a4fe-4912-8bb0-6e9074eedc4d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:26.482910 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c4e06014-a4fe-4912-8bb0-6e9074eedc4d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:26.483716 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c4e06014-a4fe-4912-8bb0-6e9074eedc4d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:26.484163 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c4e06014-a4fe-4912-8bb0-6e9074eedc4d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:26.622463 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c4e06014-a4fe-4912-8bb0-6e9074eedc4d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:26.631077 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c4e06014-a4fe-4912-8bb0-6e9074eedc4d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1357 microversion: 2.1 time: 0.159818 May 19 15:16:26.632915 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 479/957] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:26 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:27.649742 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-19e36627-e40d-409a-848b-f91f4e971e61 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:27.650278 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-19e36627-e40d-409a-848b-f91f4e971e61 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:27.658043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-19e36627-e40d-409a-848b-f91f4e971e61 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:27.658506 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-19e36627-e40d-409a-848b-f91f4e971e61 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:27.659372 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-19e36627-e40d-409a-848b-f91f4e971e61 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:27.659942 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-19e36627-e40d-409a-848b-f91f4e971e61 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:27.792480 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-19e36627-e40d-409a-848b-f91f4e971e61 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:27.800174 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-19e36627-e40d-409a-848b-f91f4e971e61 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1357 microversion: 2.1 time: 0.155005 May 19 15:16:27.809861 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 479/958] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:27 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:28.817790 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-bcddc343-33cb-4ab9-97f6-326bbcb0110c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:28.818447 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-bcddc343-33cb-4ab9-97f6-326bbcb0110c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:28.825242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bcddc343-33cb-4ab9-97f6-326bbcb0110c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:28.825767 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bcddc343-33cb-4ab9-97f6-326bbcb0110c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:28.826604 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bcddc343-33cb-4ab9-97f6-326bbcb0110c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:28.827115 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-bcddc343-33cb-4ab9-97f6-326bbcb0110c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:28.979798 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-bcddc343-33cb-4ab9-97f6-326bbcb0110c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:28.988994 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-bcddc343-33cb-4ab9-97f6-326bbcb0110c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1357 microversion: 2.1 time: 0.174987 May 19 15:16:28.989851 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 480/959] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:28 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:30.006242 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-158fbd27-b568-43ea-9f9e-01c594e0cec9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:30.016048 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-158fbd27-b568-43ea-9f9e-01c594e0cec9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:30.033033 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-158fbd27-b568-43ea-9f9e-01c594e0cec9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:30.033033 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-158fbd27-b568-43ea-9f9e-01c594e0cec9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:30.033033 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-158fbd27-b568-43ea-9f9e-01c594e0cec9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:30.033033 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-158fbd27-b568-43ea-9f9e-01c594e0cec9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:30.183915 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-158fbd27-b568-43ea-9f9e-01c594e0cec9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:30.191778 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-158fbd27-b568-43ea-9f9e-01c594e0cec9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1357 microversion: 2.1 time: 0.189654 May 19 15:16:30.201510 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 480/960] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:30 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:31.212828 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-3d82e100-da53-45ca-9950-cfda26cf5aad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:31.213487 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-3d82e100-da53-45ca-9950-cfda26cf5aad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:31.220191 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3d82e100-da53-45ca-9950-cfda26cf5aad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:31.220643 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3d82e100-da53-45ca-9950-cfda26cf5aad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:31.221416 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3d82e100-da53-45ca-9950-cfda26cf5aad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:31.221849 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-3d82e100-da53-45ca-9950-cfda26cf5aad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:31.370209 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-3d82e100-da53-45ca-9950-cfda26cf5aad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:31.379168 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-3d82e100-da53-45ca-9950-cfda26cf5aad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1357 microversion: 2.1 time: 0.171442 May 19 15:16:31.380503 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 481/961] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:31 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:32.395759 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-a9bd0405-163a-419c-9fc2-814d1d24bc7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:32.396377 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-a9bd0405-163a-419c-9fc2-814d1d24bc7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:32.402907 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a9bd0405-163a-419c-9fc2-814d1d24bc7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:32.403401 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a9bd0405-163a-419c-9fc2-814d1d24bc7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:32.404170 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a9bd0405-163a-419c-9fc2-814d1d24bc7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:32.404608 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-a9bd0405-163a-419c-9fc2-814d1d24bc7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:32.884345 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-a9bd0405-163a-419c-9fc2-814d1d24bc7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:32.891849 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-a9bd0405-163a-419c-9fc2-814d1d24bc7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1357 microversion: 2.1 time: 0.499987 May 19 15:16:32.892405 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 481/962] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:32 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1357 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:33.295722 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:33.302232 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=6 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:33.476619 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-054bb661-aa36-43b7-983c-48658027a467 req-615d0aa1-d9f4-40cd-8450-2a1d91ea2263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d6574d-1c50-4df0-ae96-b52a2441f02d", "tag": "485ce426-c3cb-4c49-843f-ac56197ea4ff"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:16:33.485874 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-054bb661-aa36-43b7-983c-48658027a467 req-615d0aa1-d9f4-40cd-8450-2a1d91ea2263 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:33.486661 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-054bb661-aa36-43b7-983c-48658027a467 req-615d0aa1-d9f4-40cd-8450-2a1d91ea2263 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:33.499282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-054bb661-aa36-43b7-983c-48658027a467 req-615d0aa1-d9f4-40cd-8450-2a1d91ea2263 service nova] Creating event network-changed:485ce426-c3cb-4c49-843f-ac56197ea4ff for instance f8d6574d-1c50-4df0-ae96-b52a2441f02d on hv-cinder-82549 May 19 15:16:33.504256 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-054bb661-aa36-43b7-983c-48658027a467 req-615d0aa1-d9f4-40cd-8450-2a1d91ea2263 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216154 May 19 15:16:33.504845 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 482/963] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:16:33.908288 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-da36463f-12c0-453f-9b24-b87e8ca2f9bf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:33.908906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-da36463f-12c0-453f-9b24-b87e8ca2f9bf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:33.910732 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell0:SELECT=6 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:33.916998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-da36463f-12c0-453f-9b24-b87e8ca2f9bf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:33.917447 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-da36463f-12c0-453f-9b24-b87e8ca2f9bf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:33.918208 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-da36463f-12c0-453f-9b24-b87e8ca2f9bf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:33.918646 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-da36463f-12c0-453f-9b24-b87e8ca2f9bf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:34.053844 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-da36463f-12c0-453f-9b24-b87e8ca2f9bf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:34.061253 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-da36463f-12c0-453f-9b24-b87e8ca2f9bf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1357 microversion: 2.1 time: 0.156820 May 19 15:16:34.061816 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 482/964] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:33 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:35.079407 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-9063a582-c776-4bd3-b3e5-91a883b0d78c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:35.080118 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-9063a582-c776-4bd3-b3e5-91a883b0d78c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:35.086282 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9063a582-c776-4bd3-b3e5-91a883b0d78c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:35.086740 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9063a582-c776-4bd3-b3e5-91a883b0d78c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:35.087548 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9063a582-c776-4bd3-b3e5-91a883b0d78c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:35.087992 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-9063a582-c776-4bd3-b3e5-91a883b0d78c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:35.220480 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-9063a582-c776-4bd3-b3e5-91a883b0d78c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:35.228541 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-9063a582-c776-4bd3-b3e5-91a883b0d78c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1357 microversion: 2.1 time: 0.153975 May 19 15:16:35.229108 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 483/965] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:35 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:36.245270 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6c004137-76d7-4c64-9833-0c84dda3f4b2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:36.245889 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-6c004137-76d7-4c64-9833-0c84dda3f4b2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:36.252714 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6c004137-76d7-4c64-9833-0c84dda3f4b2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:36.253172 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6c004137-76d7-4c64-9833-0c84dda3f4b2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:36.253944 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6c004137-76d7-4c64-9833-0c84dda3f4b2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:36.254389 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6c004137-76d7-4c64-9833-0c84dda3f4b2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:36.379765 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6c004137-76d7-4c64-9833-0c84dda3f4b2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:36.387282 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6c004137-76d7-4c64-9833-0c84dda3f4b2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1357 microversion: 2.1 time: 0.146357 May 19 15:16:36.387854 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 483/966] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:36 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:37.404373 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-8477f23b-a5a9-4e5a-af01-10f7d4b578e1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:37.405018 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-8477f23b-a5a9-4e5a-af01-10f7d4b578e1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:37.411608 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8477f23b-a5a9-4e5a-af01-10f7d4b578e1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:37.412066 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8477f23b-a5a9-4e5a-af01-10f7d4b578e1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:37.412857 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8477f23b-a5a9-4e5a-af01-10f7d4b578e1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:37.413327 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-8477f23b-a5a9-4e5a-af01-10f7d4b578e1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:37.514259 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-a2d6f10f-9804-411f-b77b-2a486c9852f2 req-a7a21982-ea7f-4045-a075-21ddb54bc6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d6574d-1c50-4df0-ae96-b52a2441f02d", "name": "network-vif-plugged", "status": "completed", "tag": "485ce426-c3cb-4c49-843f-ac56197ea4ff"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:16:37.527857 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-a2d6f10f-9804-411f-b77b-2a486c9852f2 req-a7a21982-ea7f-4045-a075-21ddb54bc6f9 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:37.528420 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-a2d6f10f-9804-411f-b77b-2a486c9852f2 req-a7a21982-ea7f-4045-a075-21ddb54bc6f9 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:37.541089 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-a2d6f10f-9804-411f-b77b-2a486c9852f2 req-a7a21982-ea7f-4045-a075-21ddb54bc6f9 service nova] Creating event network-vif-plugged:485ce426-c3cb-4c49-843f-ac56197ea4ff for instance f8d6574d-1c50-4df0-ae96-b52a2441f02d on hv-cinder-82549 May 19 15:16:37.546410 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-a2d6f10f-9804-411f-b77b-2a486c9852f2 req-a7a21982-ea7f-4045-a075-21ddb54bc6f9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101974 May 19 15:16:37.547007 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 484/967] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:16:37.561845 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-8477f23b-a5a9-4e5a-af01-10f7d4b578e1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:37.571947 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-8477f23b-a5a9-4e5a-af01-10f7d4b578e1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1357 microversion: 2.1 time: 0.171370 May 19 15:16:37.572778 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 484/968] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:37 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 15:16:38.590186 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-8b9ffa07-f5bf-4212-ba83-bcb7f6dee350 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:38.590805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-8b9ffa07-f5bf-4212-ba83-bcb7f6dee350 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:38.597224 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8b9ffa07-f5bf-4212-ba83-bcb7f6dee350 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:38.597672 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8b9ffa07-f5bf-4212-ba83-bcb7f6dee350 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:38.598429 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8b9ffa07-f5bf-4212-ba83-bcb7f6dee350 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:38.598861 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-8b9ffa07-f5bf-4212-ba83-bcb7f6dee350 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:38.728556 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-8b9ffa07-f5bf-4212-ba83-bcb7f6dee350 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:38.736014 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-8b9ffa07-f5bf-4212-ba83-bcb7f6dee350 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1357 microversion: 2.1 time: 0.150567 May 19 15:16:38.736592 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 485/969] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:38 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:39.752906 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-89f34b64-5bf9-4021-b109-2981b9b9b7ca tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:39.753459 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-89f34b64-5bf9-4021-b109-2981b9b9b7ca tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:39.759977 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-89f34b64-5bf9-4021-b109-2981b9b9b7ca tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:39.760435 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-89f34b64-5bf9-4021-b109-2981b9b9b7ca tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:39.761206 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-89f34b64-5bf9-4021-b109-2981b9b9b7ca tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:39.761649 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-89f34b64-5bf9-4021-b109-2981b9b9b7ca tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:39.889164 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-89f34b64-5bf9-4021-b109-2981b9b9b7ca tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:39.896582 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-89f34b64-5bf9-4021-b109-2981b9b9b7ca tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1545 microversion: 2.1 time: 0.147616 May 19 15:16:39.897154 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 485/970] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:39 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1545 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:39.912883 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-2d67677c-9eb5-4cf9-8177-5cc0f2ffbd0a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:39.913490 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-2d67677c-9eb5-4cf9-8177-5cc0f2ffbd0a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:39.920444 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2d67677c-9eb5-4cf9-8177-5cc0f2ffbd0a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:39.920887 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2d67677c-9eb5-4cf9-8177-5cc0f2ffbd0a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:39.921639 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2d67677c-9eb5-4cf9-8177-5cc0f2ffbd0a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:39.922070 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2d67677c-9eb5-4cf9-8177-5cc0f2ffbd0a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:40.048266 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-2d67677c-9eb5-4cf9-8177-5cc0f2ffbd0a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:40.055786 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-2d67677c-9eb5-4cf9-8177-5cc0f2ffbd0a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1545 microversion: 2.1 time: 0.146735 May 19 15:16:40.056372 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 486/971] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:39 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1545 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:40.072288 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7a925de2-13e7-4e8c-868a-4cccfd6cd813 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:40.075852 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7a925de2-13e7-4e8c-868a-4cccfd6cd813 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:40.076627 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7a925de2-13e7-4e8c-868a-4cccfd6cd813 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Searching by: {'deleted': False, 'project_id': '75c950a99db0449d914183ad7ca845a7'} {{(pid=117444) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 15:16:40.083292 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7a925de2-13e7-4e8c-868a-4cccfd6cd813 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:40.083749 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7a925de2-13e7-4e8c-868a-4cccfd6cd813 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:40.084564 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7a925de2-13e7-4e8c-868a-4cccfd6cd813 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:40.085007 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7a925de2-13e7-4e8c-868a-4cccfd6cd813 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:40.177911 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.multi_cell_list [None req-7a925de2-13e7-4e8c-868a-4cccfd6cd813 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117444) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 15:16:40.269875 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7a925de2-13e7-4e8c-868a-4cccfd6cd813 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202535 May 19 15:16:40.270457 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 486/972] 10.222.0.24 () {58 vars in 1124 bytes} [Thu May 19 15:16:40 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:16:40.281228 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-4f48e5e4-9fd9-49fe-88ab-8fb994432789 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:40.281838 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-4f48e5e4-9fd9-49fe-88ab-8fb994432789 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:40.287820 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f48e5e4-9fd9-49fe-88ab-8fb994432789 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:40.288205 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f48e5e4-9fd9-49fe-88ab-8fb994432789 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:40.288955 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f48e5e4-9fd9-49fe-88ab-8fb994432789 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:40.289390 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-4f48e5e4-9fd9-49fe-88ab-8fb994432789 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:40.416780 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-4f48e5e4-9fd9-49fe-88ab-8fb994432789 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:40.428617 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-4f48e5e4-9fd9-49fe-88ab-8fb994432789 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1545 microversion: 2.1 time: 0.151148 May 19 15:16:40.429208 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 487/973] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:40 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1545 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:41.943509 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-5f3a38c6-fec5-4ab2-9170-7bc9a8062e0f tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f381345-7a42-458b-ad79-2e569abd46c6"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:16:41.944570 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-5f3a38c6-fec5-4ab2-9170-7bc9a8062e0f tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:41.951607 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5f3a38c6-fec5-4ab2-9170-7bc9a8062e0f tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:41.952067 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5f3a38c6-fec5-4ab2-9170-7bc9a8062e0f tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:41.952843 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5f3a38c6-fec5-4ab2-9170-7bc9a8062e0f tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:41.953294 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-5f3a38c6-fec5-4ab2-9170-7bc9a8062e0f tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:42.252677 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-5f3a38c6-fec5-4ab2-9170-7bc9a8062e0f tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "POST /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313148 May 19 15:16:42.253232 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 487/974] 10.222.0.24 () {60 vars in 1322 bytes} [Thu May 19 15:16:41 2022] POST /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:16:48.739932 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6bdb6ff0-f958-41b4-ac3c-902be3bb42a0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:48.740552 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-6bdb6ff0-f958-41b4-ac3c-902be3bb42a0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:48.747998 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6bdb6ff0-f958-41b4-ac3c-902be3bb42a0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:48.748455 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6bdb6ff0-f958-41b4-ac3c-902be3bb42a0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:48.749230 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6bdb6ff0-f958-41b4-ac3c-902be3bb42a0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:48.749672 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6bdb6ff0-f958-41b4-ac3c-902be3bb42a0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:48.876453 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6bdb6ff0-f958-41b4-ac3c-902be3bb42a0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:48.884959 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6bdb6ff0-f958-41b4-ac3c-902be3bb42a0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1591 microversion: 2.1 time: 0.148847 May 19 15:16:48.885522 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 488/975] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:48 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1591 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:50.578171 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-c843994f-f2ff-468f-a0e0-f71c680c7185 req-2436b206-5879-445d-9608-633a8583cd37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d6574d-1c50-4df0-ae96-b52a2441f02d", "tag": "485ce426-c3cb-4c49-843f-ac56197ea4ff"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:16:50.585819 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell0:SELECT=2 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:50.588960 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-c843994f-f2ff-468f-a0e0-f71c680c7185 req-2436b206-5879-445d-9608-633a8583cd37 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:50.589520 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-c843994f-f2ff-468f-a0e0-f71c680c7185 req-2436b206-5879-445d-9608-633a8583cd37 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:50.605388 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-c843994f-f2ff-468f-a0e0-f71c680c7185 req-2436b206-5879-445d-9608-633a8583cd37 service nova] Creating event network-changed:485ce426-c3cb-4c49-843f-ac56197ea4ff for instance f8d6574d-1c50-4df0-ae96-b52a2441f02d on hv-cinder-82549 May 19 15:16:50.611364 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-c843994f-f2ff-468f-a0e0-f71c680c7185 req-2436b206-5879-445d-9608-633a8583cd37 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037168 May 19 15:16:50.612252 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 488/976] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:16:51.519268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-408f225f-52b9-416c-a366-6eb546e2bba0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1986826853"}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:16:51.519813 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-408f225f-52b9-416c-a366-6eb546e2bba0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:51.527342 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-408f225f-52b9-416c-a366-6eb546e2bba0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:51.527800 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-408f225f-52b9-416c-a366-6eb546e2bba0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:51.528580 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-408f225f-52b9-416c-a366-6eb546e2bba0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:51.529030 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-408f225f-52b9-416c-a366-6eb546e2bba0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:51.662904 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.network.security_group_api [None req-408f225f-52b9-416c-a366-6eb546e2bba0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Adding security group 42ca0313-0c52-47ed-87f5-282157f57d09 to port 485ce426-c3cb-4c49-843f-ac56197ea4ff May 19 15:16:52.049507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-408f225f-52b9-416c-a366-6eb546e2bba0 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "POST /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/action" status: 202 len: 0 microversion: 2.1 time: 0.533916 May 19 15:16:52.051964 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 489/977] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 15:16:51 2022] POST /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 15:16:52.059837 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-2289e3d5-9c7d-4081-a672-a3517a931cad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:16:52.061110 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-2289e3d5-9c7d-4081-a672-a3517a931cad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:16:52.069289 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2289e3d5-9c7d-4081-a672-a3517a931cad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:52.069742 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2289e3d5-9c7d-4081-a672-a3517a931cad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:52.070582 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2289e3d5-9c7d-4081-a672-a3517a931cad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:52.071017 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-2289e3d5-9c7d-4081-a672-a3517a931cad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:52.232069 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-2289e3d5-9c7d-4081-a672-a3517a931cad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:16:52.241344 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-2289e3d5-9c7d-4081-a672-a3517a931cad tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1755 microversion: 2.1 time: 0.185519 May 19 15:16:52.242271 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 489/978] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:16:52 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:16:52.626852 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-9af8c9df-c541-4b66-b140-02c115fcf8d5 req-6388713a-70a6-4c57-9241-38a92e7e8c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d6574d-1c50-4df0-ae96-b52a2441f02d", "tag": "485ce426-c3cb-4c49-843f-ac56197ea4ff"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:16:52.630517 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:52.637760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-9af8c9df-c541-4b66-b140-02c115fcf8d5 req-6388713a-70a6-4c57-9241-38a92e7e8c52 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:16:52.638207 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-9af8c9df-c541-4b66-b140-02c115fcf8d5 req-6388713a-70a6-4c57-9241-38a92e7e8c52 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:16:52.642452 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=67 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:16:52.651502 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-9af8c9df-c541-4b66-b140-02c115fcf8d5 req-6388713a-70a6-4c57-9241-38a92e7e8c52 service nova] Creating event network-changed:485ce426-c3cb-4c49-843f-ac56197ea4ff for instance f8d6574d-1c50-4df0-ae96-b52a2441f02d on hv-cinder-82549 May 19 15:16:52.656871 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-9af8c9df-c541-4b66-b140-02c115fcf8d5 req-6388713a-70a6-4c57-9241-38a92e7e8c52 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034007 May 19 15:16:52.657497 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 490/979] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:17:14.900058 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-34e754ce-5296-4a24-aaee-3a922c493b1b tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:17:14.901059 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-34e754ce-5296-4a24-aaee-3a922c493b1b tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:14.903545 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:17:14.904359 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:17:14.910266 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-34e754ce-5296-4a24-aaee-3a922c493b1b tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:14.910726 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-34e754ce-5296-4a24-aaee-3a922c493b1b tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:14.911526 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-34e754ce-5296-4a24-aaee-3a922c493b1b tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:14.911971 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-34e754ce-5296-4a24-aaee-3a922c493b1b tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:14.985212 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-34e754ce-5296-4a24-aaee-3a922c493b1b tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "POST /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/action" status: 202 len: 0 microversion: 2.1 time: 0.089328 May 19 15:17:14.985857 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 490/980] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 15:17:14 2022] POST /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:17:14.991899 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:17:14.993873 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=1 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:17:14.998348 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-25bbfe88-64cc-437c-846e-c95fabf654e9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:14.999075 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-25bbfe88-64cc-437c-846e-c95fabf654e9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:15.006656 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-25bbfe88-64cc-437c-846e-c95fabf654e9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:15.007104 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-25bbfe88-64cc-437c-846e-c95fabf654e9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:15.007895 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-25bbfe88-64cc-437c-846e-c95fabf654e9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:15.008327 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-25bbfe88-64cc-437c-846e-c95fabf654e9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:15.234858 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-25bbfe88-64cc-437c-846e-c95fabf654e9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:15.242858 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-25bbfe88-64cc-437c-846e-c95fabf654e9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1747 microversion: 2.1 time: 0.252521 May 19 15:17:15.243866 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 491/981] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:14 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1747 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:17:16.262096 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b3a97698-5ee9-47ce-b72f-0f4df41433f5 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:16.262807 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b3a97698-5ee9-47ce-b72f-0f4df41433f5 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:16.269063 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b3a97698-5ee9-47ce-b72f-0f4df41433f5 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:16.269516 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b3a97698-5ee9-47ce-b72f-0f4df41433f5 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:16.270287 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b3a97698-5ee9-47ce-b72f-0f4df41433f5 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:16.270731 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b3a97698-5ee9-47ce-b72f-0f4df41433f5 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:16.413976 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b3a97698-5ee9-47ce-b72f-0f4df41433f5 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:16.422491 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b3a97698-5ee9-47ce-b72f-0f4df41433f5 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1752 microversion: 2.1 time: 0.165172 May 19 15:17:16.423051 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 491/982] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:16 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:17:17.440029 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-98736714-9689-4703-872b-b87cb960ae66 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:17.440685 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-98736714-9689-4703-872b-b87cb960ae66 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:17.447824 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-98736714-9689-4703-872b-b87cb960ae66 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:17.448275 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-98736714-9689-4703-872b-b87cb960ae66 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:17.449042 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-98736714-9689-4703-872b-b87cb960ae66 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:17.449472 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-98736714-9689-4703-872b-b87cb960ae66 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:17.594093 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-98736714-9689-4703-872b-b87cb960ae66 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:17.601976 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-98736714-9689-4703-872b-b87cb960ae66 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1752 microversion: 2.1 time: 0.165968 May 19 15:17:17.603028 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 492/983] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:17 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:17:18.620176 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-90eb88ba-9768-45ae-9dac-baae9de08c89 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:18.620713 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-90eb88ba-9768-45ae-9dac-baae9de08c89 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:18.627436 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-90eb88ba-9768-45ae-9dac-baae9de08c89 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:18.627888 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-90eb88ba-9768-45ae-9dac-baae9de08c89 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:18.628646 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-90eb88ba-9768-45ae-9dac-baae9de08c89 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:18.629079 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-90eb88ba-9768-45ae-9dac-baae9de08c89 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:18.768591 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-90eb88ba-9768-45ae-9dac-baae9de08c89 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:18.776987 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-90eb88ba-9768-45ae-9dac-baae9de08c89 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1752 microversion: 2.1 time: 0.161474 May 19 15:17:18.777584 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 492/984] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:18 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:17:19.794310 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-624c557b-29bf-411e-880c-a54813fe7ff1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:19.794940 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-624c557b-29bf-411e-880c-a54813fe7ff1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:19.801379 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-624c557b-29bf-411e-880c-a54813fe7ff1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:19.801822 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-624c557b-29bf-411e-880c-a54813fe7ff1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:19.802577 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-624c557b-29bf-411e-880c-a54813fe7ff1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:19.803006 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-624c557b-29bf-411e-880c-a54813fe7ff1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:19.953300 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-624c557b-29bf-411e-880c-a54813fe7ff1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:19.961248 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-624c557b-29bf-411e-880c-a54813fe7ff1 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1752 microversion: 2.1 time: 0.171278 May 19 15:17:19.961813 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 493/985] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:19 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:17:20.977793 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-33c6e43a-7105-4de0-9afd-45073dfd3581 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:20.978450 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-33c6e43a-7105-4de0-9afd-45073dfd3581 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:20.984659 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33c6e43a-7105-4de0-9afd-45073dfd3581 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:20.985120 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33c6e43a-7105-4de0-9afd-45073dfd3581 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:20.985888 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33c6e43a-7105-4de0-9afd-45073dfd3581 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:20.986331 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-33c6e43a-7105-4de0-9afd-45073dfd3581 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:21.126596 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-33c6e43a-7105-4de0-9afd-45073dfd3581 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:21.135107 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-33c6e43a-7105-4de0-9afd-45073dfd3581 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1752 microversion: 2.1 time: 0.161137 May 19 15:17:21.135728 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 493/986] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:20 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:17:22.153111 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-6f399db2-d144-423c-9f2e-28dd3d5aca7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:22.153726 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-6f399db2-d144-423c-9f2e-28dd3d5aca7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:22.160201 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6f399db2-d144-423c-9f2e-28dd3d5aca7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:22.160655 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6f399db2-d144-423c-9f2e-28dd3d5aca7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:22.161419 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6f399db2-d144-423c-9f2e-28dd3d5aca7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:22.161860 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-6f399db2-d144-423c-9f2e-28dd3d5aca7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:22.300846 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-6f399db2-d144-423c-9f2e-28dd3d5aca7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:22.308757 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-6f399db2-d144-423c-9f2e-28dd3d5aca7e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1752 microversion: 2.1 time: 0.160066 May 19 15:17:22.309328 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 494/987] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:22 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:17:23.325883 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-7439e870-21a2-4479-8efd-892527ef5802 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:23.326522 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-7439e870-21a2-4479-8efd-892527ef5802 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:23.333115 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7439e870-21a2-4479-8efd-892527ef5802 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:23.333568 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7439e870-21a2-4479-8efd-892527ef5802 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:23.334339 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7439e870-21a2-4479-8efd-892527ef5802 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:23.334777 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-7439e870-21a2-4479-8efd-892527ef5802 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:23.489471 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-7439e870-21a2-4479-8efd-892527ef5802 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:23.498511 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-7439e870-21a2-4479-8efd-892527ef5802 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1752 microversion: 2.1 time: 0.176542 May 19 15:17:23.499088 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 494/988] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:23 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:17:24.515425 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-c237df63-3a18-4ddd-9de2-64305cec9727 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:24.516036 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-c237df63-3a18-4ddd-9de2-64305cec9727 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:24.522548 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c237df63-3a18-4ddd-9de2-64305cec9727 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:24.523030 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c237df63-3a18-4ddd-9de2-64305cec9727 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:24.524075 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c237df63-3a18-4ddd-9de2-64305cec9727 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:24.524518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-c237df63-3a18-4ddd-9de2-64305cec9727 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:24.664404 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-c237df63-3a18-4ddd-9de2-64305cec9727 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:24.672931 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-c237df63-3a18-4ddd-9de2-64305cec9727 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1752 microversion: 2.1 time: 0.161420 May 19 15:17:24.673495 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 495/989] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:24 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:17:25.689622 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a1ca707c-ebd4-40d7-b8de-2d86dbee1cd2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:25.690242 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a1ca707c-ebd4-40d7-b8de-2d86dbee1cd2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:25.697482 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1ca707c-ebd4-40d7-b8de-2d86dbee1cd2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:25.697932 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1ca707c-ebd4-40d7-b8de-2d86dbee1cd2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:25.698695 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1ca707c-ebd4-40d7-b8de-2d86dbee1cd2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:25.699167 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a1ca707c-ebd4-40d7-b8de-2d86dbee1cd2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:25.845060 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a1ca707c-ebd4-40d7-b8de-2d86dbee1cd2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:25.853545 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a1ca707c-ebd4-40d7-b8de-2d86dbee1cd2 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1752 microversion: 2.1 time: 0.167852 May 19 15:17:25.854110 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 495/990] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:25 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:17:26.870444 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-73b2af4f-fe5e-4ce1-a106-37dcdb27fe57 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:26.871051 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-73b2af4f-fe5e-4ce1-a106-37dcdb27fe57 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:26.878022 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-73b2af4f-fe5e-4ce1-a106-37dcdb27fe57 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:26.878473 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-73b2af4f-fe5e-4ce1-a106-37dcdb27fe57 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:26.879267 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-73b2af4f-fe5e-4ce1-a106-37dcdb27fe57 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:26.879708 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-73b2af4f-fe5e-4ce1-a106-37dcdb27fe57 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:27.021741 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-73b2af4f-fe5e-4ce1-a106-37dcdb27fe57 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:27.028831 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-73b2af4f-fe5e-4ce1-a106-37dcdb27fe57 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1752 microversion: 2.1 time: 0.162898 May 19 15:17:27.029396 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 496/991] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:26 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:17:28.045792 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b78e16ab-5904-44d4-b511-a858cbb1433c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:28.046412 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b78e16ab-5904-44d4-b511-a858cbb1433c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:28.052908 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b78e16ab-5904-44d4-b511-a858cbb1433c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:28.053366 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b78e16ab-5904-44d4-b511-a858cbb1433c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:28.054136 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b78e16ab-5904-44d4-b511-a858cbb1433c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:28.054579 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b78e16ab-5904-44d4-b511-a858cbb1433c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:28.196266 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-b78e16ab-5904-44d4-b511-a858cbb1433c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:28.204670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b78e16ab-5904-44d4-b511-a858cbb1433c tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1752 microversion: 2.1 time: 0.162767 May 19 15:17:28.205238 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 496/992] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:28 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:17:29.222224 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-d405bcef-158a-4a7e-8b78-ca4d5be416ac tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:29.222837 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-d405bcef-158a-4a7e-8b78-ca4d5be416ac tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:29.230223 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d405bcef-158a-4a7e-8b78-ca4d5be416ac tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:29.230710 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d405bcef-158a-4a7e-8b78-ca4d5be416ac tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:29.231515 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d405bcef-158a-4a7e-8b78-ca4d5be416ac tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:29.231958 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-d405bcef-158a-4a7e-8b78-ca4d5be416ac tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:29.369818 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-d405bcef-158a-4a7e-8b78-ca4d5be416ac tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:29.378035 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-d405bcef-158a-4a7e-8b78-ca4d5be416ac tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1752 microversion: 2.1 time: 0.159716 May 19 15:17:29.378604 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 497/993] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:29 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:17:30.395439 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0f753966-b302-4418-9c1e-32a87995d755 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:30.396055 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0f753966-b302-4418-9c1e-32a87995d755 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:30.402546 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0f753966-b302-4418-9c1e-32a87995d755 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:30.403002 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0f753966-b302-4418-9c1e-32a87995d755 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:30.403809 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0f753966-b302-4418-9c1e-32a87995d755 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:30.404252 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0f753966-b302-4418-9c1e-32a87995d755 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:30.542142 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-0f753966-b302-4418-9c1e-32a87995d755 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:30.550080 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0f753966-b302-4418-9c1e-32a87995d755 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1752 microversion: 2.1 time: 0.158641 May 19 15:17:30.550651 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 497/994] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:30 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:17:31.567695 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f590e8d5-5c69-4c5c-98ba-ee8ea450cf3a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:31.568288 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f590e8d5-5c69-4c5c-98ba-ee8ea450cf3a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:31.574619 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f590e8d5-5c69-4c5c-98ba-ee8ea450cf3a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:31.575073 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f590e8d5-5c69-4c5c-98ba-ee8ea450cf3a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:31.575863 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f590e8d5-5c69-4c5c-98ba-ee8ea450cf3a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:31.576296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f590e8d5-5c69-4c5c-98ba-ee8ea450cf3a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:31.720472 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-f590e8d5-5c69-4c5c-98ba-ee8ea450cf3a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:31.729005 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f590e8d5-5c69-4c5c-98ba-ee8ea450cf3a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1752 microversion: 2.1 time: 0.165241 May 19 15:17:31.729569 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 498/995] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:31 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:17:32.746513 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-15923af0-2654-4387-811a-f81ccdbbbe11 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:17:32.747670 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-15923af0-2654-4387-811a-f81ccdbbbe11 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:17:32.754077 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-15923af0-2654-4387-811a-f81ccdbbbe11 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:32.754532 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-15923af0-2654-4387-811a-f81ccdbbbe11 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:32.755322 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-15923af0-2654-4387-811a-f81ccdbbbe11 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:17:32.755757 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-15923af0-2654-4387-811a-f81ccdbbbe11 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:17:32.895050 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-15923af0-2654-4387-811a-f81ccdbbbe11 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:17:32.903646 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-15923af0-2654-4387-811a-f81ccdbbbe11 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1755 microversion: 2.1 time: 0.161629 May 19 15:17:32.904223 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 498/996] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:17:32 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:18:05.031322 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-fe2e56b4-c24c-443b-a735-ad931267f16d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1986826853"}} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:18:05.031944 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-fe2e56b4-c24c-443b-a735-ad931267f16d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:18:05.033876 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_api:SELECT=16 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:18:05.034646 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG dbcounter [-] [117445] Writing DB stats nova_cell1:SELECT=48 {{(pid=117445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:18:05.040151 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fe2e56b4-c24c-443b-a735-ad931267f16d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:05.040603 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fe2e56b4-c24c-443b-a735-ad931267f16d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:05.041367 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fe2e56b4-c24c-443b-a735-ad931267f16d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:05.041805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-fe2e56b4-c24c-443b-a735-ad931267f16d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:05.166716 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.network.security_group_api [None req-fe2e56b4-c24c-443b-a735-ad931267f16d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Removing security group 42ca0313-0c52-47ed-87f5-282157f57d09 from port 485ce426-c3cb-4c49-843f-ac56197ea4ff May 19 15:18:05.529506 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-fe2e56b4-c24c-443b-a735-ad931267f16d tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "POST /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/action" status: 202 len: 0 microversion: 2.1 time: 0.502828 May 19 15:18:05.533336 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 499/997] 10.222.0.24 () {60 vars in 1277 bytes} [Thu May 19 15:18:05 2022] POST /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:18:05.559892 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [req-c7abb775-1033-4853-a449-99aa39d6d3ca req-b76dc6d7-a86c-4d0e-bd19-f93b7569fbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d6574d-1c50-4df0-ae96-b52a2441f02d", "tag": "485ce426-c3cb-4c49-843f-ac56197ea4ff"}]} {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:18:05.564112 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_api:SELECT=18 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:18:05.564901 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG dbcounter [-] [117444] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117444) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 15:18:05.578846 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-c7abb775-1033-4853-a449-99aa39d6d3ca req-b76dc6d7-a86c-4d0e-bd19-f93b7569fbe8 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:05.579335 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [req-c7abb775-1033-4853-a449-99aa39d6d3ca req-b76dc6d7-a86c-4d0e-bd19-f93b7569fbe8 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:05.601159 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.compute.server_external_events [req-c7abb775-1033-4853-a449-99aa39d6d3ca req-b76dc6d7-a86c-4d0e-bd19-f93b7569fbe8 service nova] Creating event network-changed:485ce426-c3cb-4c49-843f-ac56197ea4ff for instance f8d6574d-1c50-4df0-ae96-b52a2441f02d on hv-cinder-82549 May 19 15:18:05.609073 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [req-c7abb775-1033-4853-a449-99aa39d6d3ca req-b76dc6d7-a86c-4d0e-bd19-f93b7569fbe8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075105 May 19 15:18:05.610602 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 499/998] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:18:06.927442 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-2d00abf3-404b-4a98-bf39-7c93322b7daa tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:18:06.927986 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-2d00abf3-404b-4a98-bf39-7c93322b7daa tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:18:06.939146 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2d00abf3-404b-4a98-bf39-7c93322b7daa tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:06.939684 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2d00abf3-404b-4a98-bf39-7c93322b7daa tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:06.940534 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2d00abf3-404b-4a98-bf39-7c93322b7daa tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:06.941063 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-2d00abf3-404b-4a98-bf39-7c93322b7daa tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:07.023307 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.objects.instance [None req-2d00abf3-404b-4a98-bf39-7c93322b7daa tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lazy-loading 'services' on Instance uuid f8d6574d-1c50-4df0-ae96-b52a2441f02d {{(pid=117445) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:18:07.106598 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-2d00abf3-404b-4a98-bf39-7c93322b7daa tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/os-volume_attachments/9f381345-7a42-458b-ad79-2e569abd46c6" status: 202 len: 0 microversion: 2.1 time: 0.183131 May 19 15:18:07.107347 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 500/999] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 15:18:06 2022] DELETE /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/os-volume_attachments/9f381345-7a42-458b-ad79-2e569abd46c6 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:18:07.117591 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-43a77201-9d47-4510-96c4-6b940fe9421e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:18:07.118612 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-43a77201-9d47-4510-96c4-6b940fe9421e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:18:07.127713 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-43a77201-9d47-4510-96c4-6b940fe9421e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:07.128395 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-43a77201-9d47-4510-96c4-6b940fe9421e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:07.129490 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-43a77201-9d47-4510-96c4-6b940fe9421e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:07.129949 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-43a77201-9d47-4510-96c4-6b940fe9421e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:07.164804 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-43a77201-9d47-4510-96c4-6b940fe9421e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052710 May 19 15:18:07.165702 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 500/1000] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:18:07 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:18:07.624507 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-b983e58d-38a2-448b-87ef-cdb752c550ef req-a1b0c13f-1110-402a-9c2b-cf06faa2b158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8d6574d-1c50-4df0-ae96-b52a2441f02d", "tag": "485ce426-c3cb-4c49-843f-ac56197ea4ff"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:18:07.632975 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-b983e58d-38a2-448b-87ef-cdb752c550ef req-a1b0c13f-1110-402a-9c2b-cf06faa2b158 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:07.633656 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-b983e58d-38a2-448b-87ef-cdb752c550ef req-a1b0c13f-1110-402a-9c2b-cf06faa2b158 service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:07.644328 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-b983e58d-38a2-448b-87ef-cdb752c550ef req-a1b0c13f-1110-402a-9c2b-cf06faa2b158 service nova] Creating event network-changed:485ce426-c3cb-4c49-843f-ac56197ea4ff for instance f8d6574d-1c50-4df0-ae96-b52a2441f02d on hv-cinder-82549 May 19 15:18:07.649277 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-b983e58d-38a2-448b-87ef-cdb752c550ef req-a1b0c13f-1110-402a-9c2b-cf06faa2b158 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029164 May 19 15:18:07.649876 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 501/1001] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 15:18:08.176693 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-0e1ead8a-1c0e-4ef4-b8f5-010d550c67c9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:18:08.177611 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-0e1ead8a-1c0e-4ef4-b8f5-010d550c67c9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:18:08.184396 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0e1ead8a-1c0e-4ef4-b8f5-010d550c67c9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:08.184841 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0e1ead8a-1c0e-4ef4-b8f5-010d550c67c9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:08.185592 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0e1ead8a-1c0e-4ef4-b8f5-010d550c67c9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:08.186021 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-0e1ead8a-1c0e-4ef4-b8f5-010d550c67c9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:08.213919 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-0e1ead8a-1c0e-4ef4-b8f5-010d550c67c9 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041219 May 19 15:18:08.214468 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 501/1002] 10.222.0.24 () {58 vars in 1301 bytes} [Thu May 19 15:18:08 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 15:18:08.224685 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f7266b0c-1a64-4eb4-977b-d28eac87855e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:18:08.225268 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-f7266b0c-1a64-4eb4-977b-d28eac87855e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:18:08.231871 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7266b0c-1a64-4eb4-977b-d28eac87855e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:08.232325 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7266b0c-1a64-4eb4-977b-d28eac87855e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:08.233088 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7266b0c-1a64-4eb4-977b-d28eac87855e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:08.233530 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-f7266b0c-1a64-4eb4-977b-d28eac87855e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:08.306372 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-f7266b0c-1a64-4eb4-977b-d28eac87855e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] HTTP exception thrown: Instance f8d6574d-1c50-4df0-ae96-b52a2441f02d is not attached to volume 9f381345-7a42-458b-ad79-2e569abd46c6 May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f7266b0c-1a64-4eb4-977b-d28eac87855e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Request method failure captured: May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: DELETE /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/os-volume_attachments/9f381345-7a42-458b-ad79-2e569abd46c6 HTTP/1.1 May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihl84XL5XqwwbjvotcaO76Cj9N_Hf8_5-3m-Gw_hmA5fva8sYxb-wNolFri-_IWr3nWda5ert-8vKu25e6SUypb7PQQiWYB3d-wStq-ycQnjP8GdskZ0epB3X9ejfw2yCmPSJI2LbXOIjPhhpW6dZHstmUOcq268U2sQ3501xRvEjjY8 May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 75c950a99db0449d914183ad7ca845a7 May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-TestMinimumBasicScenario-1087865139 May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:18:08.309340 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:18:08.310906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_75c950a99db0449d914183ad7ca845a7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/75c950a99db0449d914183ad7ca845a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/75c950a99db0449d914183ad7ca845a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/75c950a99db0449d914183ad7ca845a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:18:08.310906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-TestMinimumBasicScenario-1087865139 May 19 15:18:08.310906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 75c950a99db0449d914183ad7ca845a7 May 19 15:18:08.310906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1087865139 May 19 15:18:08.310906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-TestMinimumBasicScenario-1087865139-project May 19 15:18:08.310906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:18:08.310906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:18:08.310906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 6c9b6e614944426fb39c3784a21bbf3b May 19 15:18:08.310906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-TestMinimumBasicScenario-1087865139-project May 19 15:18:08.310906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:18:08.310906 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance f8d6574d-1c50-4df0-ae96-b52a2441f02d is not attached to volume 9f381345-7a42-458b-ad79-2e569abd46c6 May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'server_id': 'f8d6574d-1c50-4df0-ae96-b52a2441f02d', 'id': '9f381345-7a42-458b-ad79-2e569abd46c6'} May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9f381345-7a42-458b-ad79-2e569abd46c6. May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:18:08.311793 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:18:08.313296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:18:08.313296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 19 15:18:08.313296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 15:18:08.313296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d6574d-1c50-4df0-ae96-b52a2441f02d is not attached to volume 9f381345-7a42-458b-ad79-2e569abd46c6 May 19 15:18:08.313296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:18:08.313296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:18:08.313296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:18:08.313296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:18:08.313296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:18:08.313296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:18:08.313296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:18:08.313296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:18:08.313296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d6574d-1c50-4df0-ae96-b52a2441f02d is not attached to volume 9f381345-7a42-458b-ad79-2e569abd46c6 May 19 15:18:08.313296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:18:08.313296 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-f7266b0c-1a64-4eb4-977b-d28eac87855e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Returning 404 to user: Instance f8d6574d-1c50-4df0-ae96-b52a2441f02d is not attached to volume 9f381345-7a42-458b-ad79-2e569abd46c6 {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:18:08.314919 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-f7266b0c-1a64-4eb4-977b-d28eac87855e tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/os-volume_attachments/9f381345-7a42-458b-ad79-2e569abd46c6" status: 404 len: 154 microversion: 2.1 time: 0.090441 May 19 15:18:08.314919 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 502/1003] 10.222.0.24 () {58 vars in 1415 bytes} [Thu May 19 15:18:08 2022] DELETE /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d/os-volume_attachments/9f381345-7a42-458b-ad79-2e569abd46c6 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:18:09.447363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-b02f6ec7-b716-4612-9339-528577fca0df tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:18:09.447868 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b02f6ec7-b716-4612-9339-528577fca0df tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:18:09.454541 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b02f6ec7-b716-4612-9339-528577fca0df tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:09.455001 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b02f6ec7-b716-4612-9339-528577fca0df tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:09.455820 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b02f6ec7-b716-4612-9339-528577fca0df tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:09.456264 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-b02f6ec7-b716-4612-9339-528577fca0df tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:09.484326 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-b02f6ec7-b716-4612-9339-528577fca0df tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Going to try to terminate instance {{(pid=117444) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 15:18:09.559989 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-b02f6ec7-b716-4612-9339-528577fca0df tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 204 len: 0 microversion: 2.1 time: 0.116065 May 19 15:18:09.560882 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 502/1004] 10.222.0.24 () {58 vars in 1238 bytes} [Thu May 19 15:18:09 2022] DELETE /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 15:18:09.569090 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-aa8c9e4b-d2ee-4e56-92ba-c37bf339f72a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:18:09.569639 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-aa8c9e4b-d2ee-4e56-92ba-c37bf339f72a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:18:09.575757 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-aa8c9e4b-d2ee-4e56-92ba-c37bf339f72a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:09.576207 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-aa8c9e4b-d2ee-4e56-92ba-c37bf339f72a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:09.576972 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-aa8c9e4b-d2ee-4e56-92ba-c37bf339f72a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:09.577412 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-aa8c9e4b-d2ee-4e56-92ba-c37bf339f72a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:09.707849 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.policy [None req-aa8c9e4b-d2ee-4e56-92ba-c37bf339f72a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117445) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:18:09.715805 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-aa8c9e4b-d2ee-4e56-92ba-c37bf339f72a tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1551 microversion: 2.1 time: 0.150769 May 19 15:18:09.716366 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 503/1005] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:18:09 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1551 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:18:10.734551 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-a224c709-90b9-4bc6-a163-6579396d15b7 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:18:10.735303 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-a224c709-90b9-4bc6-a163-6579396d15b7 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:18:10.741747 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a224c709-90b9-4bc6-a163-6579396d15b7 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:10.742199 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a224c709-90b9-4bc6-a163-6579396d15b7 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:10.742964 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a224c709-90b9-4bc6-a163-6579396d15b7 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:10.743458 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-a224c709-90b9-4bc6-a163-6579396d15b7 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:10.870208 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-a224c709-90b9-4bc6-a163-6579396d15b7 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:18:10.878444 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-a224c709-90b9-4bc6-a163-6579396d15b7 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1551 microversion: 2.1 time: 0.148703 May 19 15:18:10.879012 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 503/1006] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:18:10 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1551 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:18:11.635330 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [req-a9c5109f-cb38-4220-86f2-04ae6c722a4c req-9449cd21-1f9e-4bcd-b7f7-f357dc482f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8d6574d-1c50-4df0-ae96-b52a2441f02d", "name": "network-vif-deleted", "tag": "485ce426-c3cb-4c49-843f-ac56197ea4ff"}]} {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 15:18:11.645043 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-a9c5109f-cb38-4220-86f2-04ae6c722a4c req-9449cd21-1f9e-4bcd-b7f7-f357dc482f5f service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:11.645478 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [req-a9c5109f-cb38-4220-86f2-04ae6c722a4c req-9449cd21-1f9e-4bcd-b7f7-f357dc482f5f service nova] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:11.657759 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.compute.server_external_events [req-a9c5109f-cb38-4220-86f2-04ae6c722a4c req-9449cd21-1f9e-4bcd-b7f7-f357dc482f5f service nova] Creating event network-vif-deleted:485ce426-c3cb-4c49-843f-ac56197ea4ff for instance f8d6574d-1c50-4df0-ae96-b52a2441f02d on hv-cinder-82549 May 19 15:18:11.662615 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [req-a9c5109f-cb38-4220-86f2-04ae6c722a4c req-9449cd21-1f9e-4bcd-b7f7-f357dc482f5f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030951 May 19 15:18:11.663203 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 504/1007] 10.222.0.24 () {64 vars in 1317 bytes} [Thu May 19 15:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 15:18:11.895576 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-c2687677-fa51-47d0-b074-03f3292dcba6 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:18:11.896124 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.compute.api [None req-c2687677-fa51-47d0-b074-03f3292dcba6 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117444) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:18:11.902609 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c2687677-fa51-47d0-b074-03f3292dcba6 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:11.903112 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c2687677-fa51-47d0-b074-03f3292dcba6 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:11.903934 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c2687677-fa51-47d0-b074-03f3292dcba6 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:11.904377 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c2687677-fa51-47d0-b074-03f3292dcba6 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:11.936345 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c2687677-fa51-47d0-b074-03f3292dcba6 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:11.936904 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG oslo_concurrency.lockutils [None req-c2687677-fa51-47d0-b074-03f3292dcba6 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:11.937254 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.objects.instance [None req-c2687677-fa51-47d0-b074-03f3292dcba6 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lazy-loading 'fault' on Instance uuid f8d6574d-1c50-4df0-ae96-b52a2441f02d {{(pid=117444) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 15:18:11.981844 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.policy [None req-c2687677-fa51-47d0-b074-03f3292dcba6 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9b6e614944426fb39c3784a21bbf3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75c950a99db0449d914183ad7ca845a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117444) authorize /opt/stack/nova/nova/policy.py:199}} May 19 15:18:11.989404 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-c2687677-fa51-47d0-b074-03f3292dcba6 tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 200 len: 1347 microversion: 2.1 time: 0.098166 May 19 15:18:11.989989 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 504/1008] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:18:11 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 1347 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 15:18:13.008194 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-25e0f57f-350f-45a7-b23c-de5fe949becf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '>' {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:18:13.008899 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.compute.api [None req-25e0f57f-350f-45a7-b23c-de5fe949becf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] [instance: f8d6574d-1c50-4df0-ae96-b52a2441f02d] Fetching instance by UUID {{(pid=117445) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 15:18:13.015184 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-25e0f57f-350f-45a7-b23c-de5fe949becf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:13.015667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-25e0f57f-350f-45a7-b23c-de5fe949becf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:13.016433 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-25e0f57f-350f-45a7-b23c-de5fe949becf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 15:18:13.016875 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG oslo_concurrency.lockutils [None req-25e0f57f-350f-45a7-b23c-de5fe949becf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Lock "29378f11-e05f-41fc-b3d7-85c26456dbc0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117445) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 15:18:13.029672 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.wsgi [None req-25e0f57f-350f-45a7-b23c-de5fe949becf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] HTTP exception thrown: Instance f8d6574d-1c50-4df0-ae96-b52a2441f02d could not be found. May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-25e0f57f-350f-45a7-b23c-de5fe949becf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Request method failure captured: May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: request: GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d HTTP/1.1 May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept: application/json May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Accept-Encoding: identity May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Connection: close May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Length: 0 May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Content-Type: application/json May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Host: 10.222.0.24 May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Openstack-System-Scope: None May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: User-Agent: python-urllib3/1.26.9 May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Auth-Token: gAAAAABihl84XL5XqwwbjvotcaO76Cj9N_Hf8_5-3m-Gw_hmA5fva8sYxb-wNolFri-_IWr3nWda5ert-8vKu25e6SUypb7PQQiWYB3d-wStq-ycQnjP8GdskZ0epB3X9ejfw2yCmPSJI2LbXOIjPhhpW6dZHstmUOcq268U2sQ3501xRvEjjY8 May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Id: None May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Domain-Name: None May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Identity-Status: Confirmed May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Is-Admin-Project: True May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Id: default May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Domain-Name: Default May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Id: 75c950a99db0449d914183ad7ca845a7 May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Project-Name: tempest-TestMinimumBasicScenario-1087865139 May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Role: member,reader May 19 15:18:13.031284 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Roles: member,reader May 19 15:18:13.033012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_75c950a99db0449d914183ad7ca845a7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/75c950a99db0449d914183ad7ca845a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/75c950a99db0449d914183ad7ca845a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/75c950a99db0449d914183ad7ca845a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 19 15:18:13.033012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant: tempest-TestMinimumBasicScenario-1087865139 May 19 15:18:13.033012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Id: 75c950a99db0449d914183ad7ca845a7 May 19 15:18:13.033012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1087865139 May 19 15:18:13.033012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User: tempest-TestMinimumBasicScenario-1087865139-project May 19 15:18:13.033012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Id: default May 19 15:18:13.033012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Domain-Name: Default May 19 15:18:13.033012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Id: 6c9b6e614944426fb39c3784a21bbf3b May 19 15:18:13.033012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: X-User-Name: tempest-TestMinimumBasicScenario-1087865139-project May 19 15:18:13.033012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: method: > May 19 15:18:13.033012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: exception: Instance f8d6574d-1c50-4df0-ae96-b52a2441f02d could not be found. May 19 15:18:13.033012 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: action_args: {'id': 'f8d6574d-1c50-4df0-ae96-b52a2441f02d'} May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: {{(pid=117445) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d6574d-1c50-4df0-ae96-b52a2441f02d could not be found. May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 15:18:13.034008 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d6574d-1c50-4df0-ae96-b52a2441f02d could not be found. May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d6574d-1c50-4df0-ae96-b52a2441f02d could not be found. May 19 15:18:13.035667 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: ERROR nova.api.openstack.wsgi May 19 15:18:13.037445 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: DEBUG nova.api.openstack.wsgi [None req-25e0f57f-350f-45a7-b23c-de5fe949becf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Returning 404 to user: Instance f8d6574d-1c50-4df0-ae96-b52a2441f02d could not be found. {{(pid=117445) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 15:18:13.037445 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO nova.api.openstack.requestlog [None req-25e0f57f-350f-45a7-b23c-de5fe949becf tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d" status: 404 len: 111 microversion: 2.1 time: 0.029192 May 19 15:18:13.037445 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: [pid: 117445|app: 0|req: 505/1009] 10.222.0.24 () {58 vars in 1235 bytes} [Thu May 19 15:18:13 2022] GET /compute/v2.1/servers/f8d6574d-1c50-4df0-ae96-b52a2441f02d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 15:18:13.041180 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: DEBUG nova.api.openstack.wsgi [None req-be35e7fb-8095-425a-bf37-9fd2caf078fd tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] Calling method '.version_select at 0x7f35d13d3310>' {{(pid=117444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 15:18:13.059363 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO nova.api.openstack.requestlog [None req-be35e7fb-8095-425a-bf37-9fd2caf078fd tempest-TestMinimumBasicScenario-1087865139 tempest-TestMinimumBasicScenario-1087865139-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-774751696" status: 202 len: 0 microversion: 2.1 time: 0.021816 May 19 15:18:13.059907 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: [pid: 117444|app: 0|req: 505/1010] 10.222.0.24 () {58 vars in 1268 bytes} [Thu May 19 15:18:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-774751696 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 15:18:51.373995 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:18:51.374567 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Thu May 19 15:18:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 15:19:02.481518 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:19:02.482111 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Thu May 19 15:19:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 15:19:20.372320 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:19:20.373634 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Thu May 19 15:19:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 15:20:39.564440 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:20:39.564959 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Thu May 19 15:20:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 15:20:50.529403 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:20:50.529945 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Thu May 19 15:20:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 15:21:03.940258 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:21:03.940784 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Thu May 19 15:21:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 15:22:11.382062 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:22:11.382701 dv-cinder-825492-12-iscsi devstack@n-api.service[117444]: Thu May 19 15:22:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 15:22:22.491078 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:22:22.491703 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Thu May 19 15:22:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 15:22:40.380760 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 15:22:40.381359 dv-cinder-825492-12-iscsi devstack@n-api.service[117445]: Thu May 19 15:22:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!